-- Logs begin at Mon 2022-07-25 21:42:08 UTC, end at Mon 2022-07-25 23:10:23 UTC. -- Jul 25 22:33:03.706979 dv-cinder-797608-63-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 22:33:03.714321 dv-cinder-797608-63-smb devstack@keystone.service[87117]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 22:33:03 2022] *** Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: nodename: dv-cinder-797608-63-smb Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: machine: x86_64 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: clock source: unix Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: pcre jit disabled Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: detected number of CPU cores: 4 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: current working directory: / Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: detected binary path: /usr/bin/uwsgi-core Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: your processes number limit is 47680 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: your memory page size is 4096 bytes Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: detected max file descriptor number: 2048 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: lock engine: pthread robust mutexes Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: thunder lock: enabled Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 22:33:03.719130 dv-cinder-797608-63-smb devstack@keystone.service[87117]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 22:33:03.759320 dv-cinder-797608-63-smb devstack@keystone.service[87117]: Python main interpreter initialized at 0x55bd94f279c0 Jul 25 22:33:03.759320 dv-cinder-797608-63-smb devstack@keystone.service[87117]: python threads support enabled Jul 25 22:33:03.759320 dv-cinder-797608-63-smb devstack@keystone.service[87117]: your server socket listen backlog is limited to 100 connections Jul 25 22:33:03.759320 dv-cinder-797608-63-smb devstack@keystone.service[87117]: your mercy for graceful operations on workers is 90 seconds Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: *** Operational MODE: preforking *** Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: *** uWSGI is running in multiple interpreter mode *** Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: spawned uWSGI master process (pid: 87117) Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: spawned uWSGI worker 1 (pid: 87130, cores: 1) Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: spawned uWSGI worker 2 (pid: 87131, cores: 1) Jul 25 22:33:03.768308 dv-cinder-797608-63-smb devstack@keystone.service[87117]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 22:33:03.760252 dv-cinder-797608-63-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 22:33:09.449452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:33:09.449452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: from cryptography.utils import int_from_bytes Jul 25 22:33:09.450260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:33:09.450260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: from cryptography.utils import int_from_bytes Jul 25 22:33:09.455163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:33:09.455163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: from cryptography.utils import int_from_bytes Jul 25 22:33:09.455638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:33:09.455638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: from cryptography.utils import int_from_bytes Jul 25 22:33:09.501215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:33:09.501398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:33:09.501576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] command line args: [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:33:09.501845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:33:09.502022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ================================================================================ {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:33:09.502273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] admin_token = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.502517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] config_dir = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.502704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.502884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] config_source = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.503061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] debug = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.503258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.503521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:33:09.503521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:33:09.503655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.503719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] command line args: [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:33:09.503804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.503990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:33:09.504073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ================================================================================ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:33:09.504267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504565 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] admin_token = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_config_append = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] config_dir = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.504986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_dir = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] config_source = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_file = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] debug = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.505940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_config_append = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.506931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_dir = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.507963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.508937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] publish_errors = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.509951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510177 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] standard_threads = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.510995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] publish_errors = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] use_journal = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] use_json = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] use_stderr = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] use_syslog = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.511787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.512027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.512129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.512202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.512315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.512428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.512563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] standard_threads = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.512683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.512795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.512917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.513037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.513191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.513273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.513377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] use_journal = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.513453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.513552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] use_json = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.513629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.513711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] use_stderr = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.513836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.514421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] use_syslog = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.514628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.514726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:33:09.514875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.515948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.516913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.517868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.518970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.519915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520853 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.520969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.521917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.522867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.523973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.524922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.525997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.526921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.527971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.528882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.529051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.529127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.529285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.529371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.529524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.530194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.530377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.530510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.530636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.530869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.530991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.531929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.532892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.533988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.534929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.535970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.536905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.537968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.external = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.538971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.password = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] auth.token = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.539983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.540344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.540439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.540595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.540684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.external = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.540824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.540905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.password = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.541856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] auth.token = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.542970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.543958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.544939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.545943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.546925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.547911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.548904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.549957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.550897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.551989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.552935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.553997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.554911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.555988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.556921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.557970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.558901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.559969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.560950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.561944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.562990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.563930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.564961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.565907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.566958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.567922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.568917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.569978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.570922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.571793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] role.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] role.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.572967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.573903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] role.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] role.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.574962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.575951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.576068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.576183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.576309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.576932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.577962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.578885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.579948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.580894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.581940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.582994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.583939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.584879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.connection = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.585834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.586985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.587943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.588987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.589104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.589219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:33:09.589334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.589334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.589549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.589673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.589843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.590092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.590329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.590576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.590807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.591048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.591283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:33:09.591546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:33:09.619292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.619522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.619747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.620854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.621088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.621313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.629151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.630437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.660866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.661091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.661625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.661861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.715359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.715992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.767249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.767477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.767574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.767734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.834925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.835012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.835141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.835226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.835351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.859949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.860922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.861045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.861127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.861259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.861341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.872669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.872824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.885579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.885864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.885950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.886980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.887062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.887196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:33:09.904424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.905219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:33:09.905383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.905596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:33:09.905759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.905932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.906025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:33:09.906133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:33:09.906278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.906400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.906536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.906658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.906792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.906915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.907044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.907169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.917016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.929902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.929975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.930406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.930490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.930715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.930811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.930969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.931883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.932948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.933123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.933202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.956441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.956798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.957921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.958202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.958284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.958531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.962863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.963121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.963206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.963396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.963478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.963673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.970643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.970922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.971141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.971424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.975724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.975981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.976069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.976957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.977157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.977240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.977426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.977510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.977704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.977788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.994514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.994630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.994790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.994877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:09.998819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:09.999006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.002132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.002229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.002438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.002560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.006844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.006939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.010119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.010211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.013291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.013380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.013588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.013687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.013881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.013965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.014256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.014343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.014547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.014765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.014851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.015067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.031604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.031914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.032017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.032224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.032325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.032432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.032542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.032801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.039346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.039680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.041166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.041442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.041527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.041750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.044367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.044574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.044697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.044855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.044966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.045163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.045276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.046089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.046176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.046602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.057589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.057870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.058086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.058172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.058363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.058447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.058640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.058724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.058919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.059005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.059192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.059274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.059463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.059733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.074940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.075631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.078581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.079423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.081574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.082426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.084258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.085044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.085939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.086241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.086530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.086615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.086809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.087086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.093714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.094470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.095380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.096100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.098342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.098633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.098928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.099060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.099207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.099292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.099543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.099848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.107401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.107915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.108016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.108095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.108393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.108692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.115084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.115365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.115519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:33:10.115645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.115821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.115948 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.116103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.116230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.116378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.116501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.116659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.116781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.117964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.118899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.119089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.119358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:33:10.152937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bd94f279c0 pid: 87130 (default app) Jul 25 22:33:10.153870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bd94f279c0 pid: 87131 (default app) Jul 25 22:33:10.157095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69adcc-ce45-4f95-98a4-f145e1426f9c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:10.157389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69adcc-ce45-4f95-98a4-f145e1426f9c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:10.157668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69adcc-ce45-4f95-98a4-f145e1426f9c None None] PATH_INFO: `/v3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:10.162016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Mon Jul 25 22:33:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:18.902728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:18.903288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:18.903288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:18.907914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:33:18.913284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:18.913713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:18.913857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:18.987003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: INFO dbcounter [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] Registered counter for database keystone Jul 25 22:33:19.009212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG oslo_db.sqlalchemy.engines [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:33:19.015902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writer thread running {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:33:19.200490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG passlib.handlers.bcrypt [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87130) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:33:19.200844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG passlib.handlers.bcrypt [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87130) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:33:19.256337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:19.257998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:19.389403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 22:33:19.534090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:19.603652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: INFO dbcounter [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] Registered counter for database keystone Jul 25 22:33:19.623590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG oslo_db.sqlalchemy.engines [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:33:19.629854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writer thread running {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:33:19.749984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fd46a-8a20-4c7b-857f-ddffa81f92b9 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:19.754316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:19.754948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:19.755238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:19.755514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:19.764245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:19.815959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:33:19.816228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c8ed9-ac40-4faa-8f25-ba2255d41c5f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:19.827019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Jul 25 22:33:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:33:19.833001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:19.847944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81717e1f-a3ef-4442-95f3-5d3f16a07a75 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:19.852605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:19.853543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:19.853836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:19.854129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] PATH_INFO: `/v3/projects/1511155764c640988e6e51d316abf862` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:19.855664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] RBAC: Authorizing `identity:get_project(project_id=1511155764c640988e6e51d316abf862)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:19.907645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING keystone.common.rbac_enforcer.enforcer [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:33:19.908030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9ce68-8ed7-4f78-b2d7-26e9637fbb78 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:19.912887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Mon Jul 25 22:33:19 2022] GET /identity/v3/projects/1511155764c640988e6e51d316abf862 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:21.902457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24f7b3-ddd4-4032-b355-8533d6dcb33a None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:21.902997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24f7b3-ddd4-4032-b355-8533d6dcb33a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:21.902997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24f7b3-ddd4-4032-b355-8533d6dcb33a None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:21.907601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:21.913036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:21.913435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:21.913610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:21.933699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:21.935743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:21.943546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 22:33:21.965661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24f7b3-ddd4-4032-b355-8533d6dcb33a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:21.978212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24f7b3-ddd4-4032-b355-8533d6dcb33a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:21.982479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdd22c-dd3d-4326-9f0c-7ca5f58a7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:21.983089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdd22c-dd3d-4326-9f0c-7ca5f58a7775 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:21.983375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdd22c-dd3d-4326-9f0c-7ca5f58a7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:21.983680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdd22c-dd3d-4326-9f0c-7ca5f58a7775 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:21.991491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdd22c-dd3d-4326-9f0c-7ca5f58a7775 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:21.999327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdd22c-dd3d-4326-9f0c-7ca5f58a7775 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:22.002565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Jul 25 22:33:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:33:22.008155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:22.017863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f03e2-381c-4095-80f5-983433f65869 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:22.022283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22bc1-42c0-4774-90ea-5af47afbfb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:22.028118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22bc1-42c0-4774-90ea-5af47afbfb90 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:22.028118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22bc1-42c0-4774-90ea-5af47afbfb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:22.028118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22bc1-42c0-4774-90ea-5af47afbfb90 admin admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:22.028118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22bc1-42c0-4774-90ea-5af47afbfb90 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:22.028118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22bc1-42c0-4774-90ea-5af47afbfb90 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:22.028589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Mon Jul 25 22:33:22 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:24.106942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6401-71e6-4b73-ba54-3e041bbf86c9 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.107993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6401-71e6-4b73-ba54-3e041bbf86c9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.108083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6401-71e6-4b73-ba54-3e041bbf86c9 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.109425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:24.114623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.115065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.115307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.134363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:24.135560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:24.137082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d352910-1b3b-4422-a806-e58b5f50f391 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.137383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d352910-1b3b-4422-a806-e58b5f50f391 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.137854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d352910-1b3b-4422-a806-e58b5f50f391 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.139509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:33:24.144797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.145091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.145374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.188056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG passlib.handlers.bcrypt [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:33:24.188482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG passlib.handlers.bcrypt [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:33:24.217935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:24.234538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:24.236147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:24.240868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.264459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:24.338686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:24.351784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfa98-755b-4fa4-9479-ad50b388ca16 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.361087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.381229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:24.381883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.382176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.382453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.394771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:24.403280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:24.405059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:24.406016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:33:24.411322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.464008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893bea-fefd-472f-8084-40b848ca030e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.466949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:24.493742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:24.502466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:24.503537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.503857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.504137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.511866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43ad5-5dac-4ed1-957f-0d648627774d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.547407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:24.548054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.548339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.548616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.549349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:24.549656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:24.551051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:24.563103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:24.568713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.571946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:24.573457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:24.667681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fb99-648c-48c2-a014-b391e02e1234 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.672462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:33:24.678020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.680823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:24.703794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:24.704433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.704752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.705032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.706207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:24.707741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:24.709369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:24.714853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.729754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:24.778493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0bc85-ca58-45e2-9821-35274e807834 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.818425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:24.819310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.819596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.819920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.841824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:24.843416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:33:24.863074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:24.863996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:24.864778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:33:24.864778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:33:24.864778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:33:24.864778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:24.864778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:33:24.870199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:24.926333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482a33-aac4-4a9e-a8b4-a30382c77b45 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.928175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:24.960077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:24.960730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:24.961021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:24.961298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:24.962459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:24.963944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:24.965634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:24.970631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ef8b-58eb-4ee6-ac40-01b6a3f57bc5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:24.972076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:25.005931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:25.006560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:25.006849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:25.007126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:25.007877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:25.008188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:25.009618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec96a6-7fda-4354-8828-42f1a28861f2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:25.026959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:25.058613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:25.079895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76dd50-1bf0-446c-a202-a19b9287d215 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:25.119701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:25.120401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:25.120643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:25.120920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:25.121731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.domain.id=default, user.id=0e22f2132e234963b03344d9530151a7) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:25.122046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:25.123640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98616f-2f9e-413d-bb7b-a3b1a654340a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:25.131345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Jul 25 22:33:24 2022] GET /identity/v3/role_assignments?user.id=0e22f2132e234963b03344d9530151a7&scope.domain.id=default&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:27.434030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5336e-6a82-43ca-963c-1aa3ebd9ba91 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.435630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5336e-6a82-43ca-963c-1aa3ebd9ba91 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.436156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5336e-6a82-43ca-963c-1aa3ebd9ba91 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.437752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:27.443187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.443626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.443744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.449976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c315e77-f613-41f1-b71a-15bed82180c8 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.451374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c315e77-f613-41f1-b71a-15bed82180c8 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.452023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c315e77-f613-41f1-b71a-15bed82180c8 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.453609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 12/23] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:33:27.460229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.460793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.461296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.474850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:27.477286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:27.501133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:27.502788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:27.599655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:27.623020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:27.633657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:27.670327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:27.754918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:27.756160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cc3c0-2e19-41b2-836c-5c0ab3eff52a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:27.772281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:27.813228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402d62-8ecd-41d6-a40c-c2aa8cd8491f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:27.817456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63455eaf-1a0c-42bb-bd13-0454673d663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:27.819574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455eaf-1a0c-42bb-bd13-0454673d663e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.819574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455eaf-1a0c-42bb-bd13-0454673d663e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.819574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455eaf-1a0c-42bb-bd13-0454673d663e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.841861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63455eaf-1a0c-42bb-bd13-0454673d663e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-63455eaf-1a0c-42bb-bd13-0454673d663e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:27.847135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:27.848023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:27.848764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:27.851147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 13/26] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:27.851472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:27.855792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.855792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.855792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.858991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861abb2-314c-447b-91cb-dba38a37c359 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.859278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861abb2-314c-447b-91cb-dba38a37c359 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.859779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861abb2-314c-447b-91cb-dba38a37c359 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.861672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:27.862597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861abb2-314c-447b-91cb-dba38a37c359 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:27.864899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:27.866588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-5f83745c-eb6f-4ebd-a2c0-d177758c0e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:33:27.882790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:27.883740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:27.884783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:33:27.884783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:33:27.884783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:33:27.884783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:27.886330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 14/28] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:27.887732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:27.888321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:27.888743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:27.910130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:27.911703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:27.993406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 15/29] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:27.994607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:28.069748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861abb2-314c-447b-91cb-dba38a37c359 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:28.146176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:28.147159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.147665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.148161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.149092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:28.149601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:28.151245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:28.156085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:28.168769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 15/30] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:28.170612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:28.197998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:28.373045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcba842-6c37-4fdc-9ae1-3a9a265b95ee None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:28.407126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58471-8d49-4b2a-8f02-de76d0efff96 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:28.416334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:28.416976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.417263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.417544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.418255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:28.418733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:28.421563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:28.434024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 16/31] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:28.435788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:28.465623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee987-6377-48ec-b5eb-6b471780d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:28.466403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee987-6377-48ec-b5eb-6b471780d987 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.467229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee987-6377-48ec-b5eb-6b471780d987 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.467604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee987-6377-48ec-b5eb-6b471780d987 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.468715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee987-6377-48ec-b5eb-6b471780d987 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:28.470434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee987-6377-48ec-b5eb-6b471780d987 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:28.548728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:28.561680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba836-5d55-4c2e-9d1f-939fba13fba7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:28.615147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:28.616174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.616629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.617080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.619621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:28.622080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:28.625897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 17/32] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:28 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:28.627380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:28.733474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 16/33] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 25 22:33:28 2022] POST /identity/v3/roles => generated 219 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:28.737218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250f64f-d813-448e-bc33-94a2dba27582 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.737218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250f64f-d813-448e-bc33-94a2dba27582 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.737218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250f64f-d813-448e-bc33-94a2dba27582 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.748802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 17/34] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:28.748802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250f64f-d813-448e-bc33-94a2dba27582 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:28.768292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c644a-ea10-4221-9669-0beb6fdf559a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:28.833432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4729e-b0a3-4823-b6d6-a677b9e9bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:28.834568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4729e-b0a3-4823-b6d6-a677b9e9bdf7 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.835285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4729e-b0a3-4823-b6d6-a677b9e9bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.836915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4729e-b0a3-4823-b6d6-a677b9e9bdf7 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.838469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4729e-b0a3-4823-b6d6-a677b9e9bdf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:28.840699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4729e-b0a3-4823-b6d6-a677b9e9bdf7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:28.892714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:28.952409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250f64f-d813-448e-bc33-94a2dba27582 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:28.993656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d559b12-c213-4ee9-881a-d7af4ebb08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:28.993656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d559b12-c213-4ee9-881a-d7af4ebb08b8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.993656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d559b12-c213-4ee9-881a-d7af4ebb08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.993656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d559b12-c213-4ee9-881a-d7af4ebb08b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:28.994068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d559b12-c213-4ee9-881a-d7af4ebb08b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:28.994068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d559b12-c213-4ee9-881a-d7af4ebb08b8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:28.994210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 18/35] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:28.995313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0cbd3-14b0-45b0-8ebe-b75a62a27838 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:28.995605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0cbd3-14b0-45b0-8ebe-b75a62a27838 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:28.995914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0cbd3-14b0-45b0-8ebe-b75a62a27838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.014763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-76f0cbd3-14b0-45b0-8ebe-b75a62a27838 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:29.016342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-76f0cbd3-14b0-45b0-8ebe-b75a62a27838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:29.087571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 19/36] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:29.100146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88412059-fa3f-4cfd-acb8-9ed0d070c08a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.100146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88412059-fa3f-4cfd-acb8-9ed0d070c08a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.100146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88412059-fa3f-4cfd-acb8-9ed0d070c08a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.100146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 20/37] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:29.100146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cd335-5d3c-4592-b0c7-33211be3eae7 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.100146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cd335-5d3c-4592-b0c7-33211be3eae7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.100572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cd335-5d3c-4592-b0c7-33211be3eae7 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.100572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 21/38] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:29.100572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cd335-5d3c-4592-b0c7-33211be3eae7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:29.130963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 18/39] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:33:28 2022] POST /identity/v3/projects => generated 301 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:29.132400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f834ae-b820-422c-91a8-7de0ff3c17df None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.132749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f834ae-b820-422c-91a8-7de0ff3c17df None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.133174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f834ae-b820-422c-91a8-7de0ff3c17df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.158556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-47f834ae-b820-422c-91a8-7de0ff3c17df None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:29.160267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-47f834ae-b820-422c-91a8-7de0ff3c17df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:29.162670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:29.188947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:29.243573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:29.245001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.245232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.245515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.248178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cd335-5d3c-4592-b0c7-33211be3eae7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:29.268480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:29.269748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:29.303434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:29.304157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.304444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.304741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] PATH_INFO: `/v3/domains/default/users/0e22f2132e234963b03344d9530151a7/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.306887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0e22f2132e234963b03344d9530151a7, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:29.308434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:29.359601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 20/41] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:29.360588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:29.408812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 22/42] 10.222.0.40 () {58 vars in 1361 bytes} [Mon Jul 25 22:33:29 2022] PUT /identity/v3/domains/default/users/0e22f2132e234963b03344d9530151a7/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:29.409889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:29.455281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:29.496331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec9d5-40c9-4242-9277-1bac33f96e78 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:29.540307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:29.541098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.541393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.541680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.542445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:29.544111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:29.548920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131775bc-4424-4d2f-a3bb-dcbc4f609b0a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:29.567320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:29.599581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:29.600499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.600924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.601369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.602682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:29.604949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:29.635907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 21/43] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 25 22:33:29 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:29.636781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:29.721997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 25 22:33:29 2022] POST /identity/v3/roles => generated 223 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:29.791500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bd0fb-7a09-4061-946b-638d52588925 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:29.835174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:29.852113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ff69-efd2-4814-98ea-d7939eb7e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:29.853316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ff69-efd2-4814-98ea-d7939eb7e8db None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:29.853792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ff69-efd2-4814-98ea-d7939eb7e8db None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:29.854258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ff69-efd2-4814-98ea-d7939eb7e8db None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:29.857387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ff69-efd2-4814-98ea-d7939eb7e8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:29.860530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ff69-efd2-4814-98ea-d7939eb7e8db None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:29.862791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 22/45] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:29.869312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:30.011329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4ef9-3d98-40dd-af4b-758e15d95ed5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:30.049962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d25f-0249-4c41-ab7a-ea328c3a7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:30.050512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d25f-0249-4c41-ab7a-ea328c3a7e8d None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:30.050802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d25f-0249-4c41-ab7a-ea328c3a7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:30.051185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d25f-0249-4c41-ab7a-ea328c3a7e8d None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:30.051932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d25f-0249-4c41-ab7a-ea328c3a7e8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:30.053407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d25f-0249-4c41-ab7a-ea328c3a7e8d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:30.150840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:33:29 2022] POST /identity/v3/projects => generated 312 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:31.656285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba4ec9-fb6a-4cee-9ca7-0692f8f33b8c None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:31.656831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba4ec9-fb6a-4cee-9ca7-0692f8f33b8c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:31.656831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba4ec9-fb6a-4cee-9ca7-0692f8f33b8c None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:31.658221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 23/47] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:31.663855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:31.664574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:31.664774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:31.683780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:31.685027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:31.708439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:31.758067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:31.782477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba4ec9-fb6a-4cee-9ca7-0692f8f33b8c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:31.896259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba4ec9-fb6a-4cee-9ca7-0692f8f33b8c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:31.931287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:31.931883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:31.932178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:31.932462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:31.945590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:31.952354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:31.953215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:31.953942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 24/49] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:31.959472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:32.064138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884076a-c6fd-4c51-bb64-13ff21605136 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:32.099797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:32.100423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.100707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.100985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.101712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:32.102017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:32.103408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d902ee4-48df-4828-be57-66716f67fa3b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:32.113028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 26/50] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:32.118792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:32.178519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:32.209747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904626-107e-42d8-a2e1-9b758ca1e20c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.209956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904626-107e-42d8-a2e1-9b758ca1e20c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.210242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904626-107e-42d8-a2e1-9b758ca1e20c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.211635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 27/51] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:32.217583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.217877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.218161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.224754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054518b5-1c3e-426b-b53b-13713ce94327 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:32.236531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:32.237778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:32.252592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:32.260259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:32.260921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.261212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.261494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.263558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:32.265140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:32.266946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 25/52] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:32 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:32.272640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:32.312689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 28/53] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:32.336433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:32.377633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add2ab8-9d8a-40ac-92d1-18a7bf93792e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:32.401425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:32.412268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:32.412928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.413215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.413496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.414934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:32.416446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:32.418089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 26/54] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:32.424101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:32.444945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b6ae-5905-49c3-8cb4-4b14739355f9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:32.484702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:32.485272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.485558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.485832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.486980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:32.488466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:32.490050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 29/55] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:32.495812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:32.515436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:32.529432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e92ce7-8a22-43b9-9eb0-0747f39ce7fd None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:32.566175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:32.566827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.567120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.567399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.568266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.domain.id=default, user.id=0e22f2132e234963b03344d9530151a7) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:32.568590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:32.570067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae184-129c-49e2-8cdd-bfab1b9db4d6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:32.580488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 27/56] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Jul 25 22:33:32 2022] GET /identity/v3/role_assignments?user.id=0e22f2132e234963b03344d9530151a7&scope.domain.id=default&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:32.607601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee43bce-5f59-4202-bfda-9ffda90f8cf8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:32.645824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba12f-040d-4cbc-b8ae-910196c5c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:32.646467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba12f-040d-4cbc-b8ae-910196c5c0bf None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:32.646759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba12f-040d-4cbc-b8ae-910196c5c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:32.647039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba12f-040d-4cbc-b8ae-910196c5c0bf None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:32.647775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba12f-040d-4cbc-b8ae-910196c5c0bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:32.649263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba12f-040d-4cbc-b8ae-910196c5c0bf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:32.728588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 30/57] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Jul 25 22:33:32 2022] POST /identity/v3/projects => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:33:34.745493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0a5d-732f-4cb9-bccc-f05cfdcbf10c None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:34.746034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0a5d-732f-4cb9-bccc-f05cfdcbf10c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:34.746131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0a5d-732f-4cb9-bccc-f05cfdcbf10c None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:34.748145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 28/58] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:34.753324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:34.753835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:34.753926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:34.772672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:34.773869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:34.836664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:34.842300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 31/59] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:34.866775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0a5d-732f-4cb9-bccc-f05cfdcbf10c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:34.924877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:34.970951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0a5d-732f-4cb9-bccc-f05cfdcbf10c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:35.005722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8902-a739-4dd0-a966-2f11ca26c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:35.006294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8902-a739-4dd0-a966-2f11ca26c50c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:35.006583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8902-a739-4dd0-a966-2f11ca26c50c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:35.006858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8902-a739-4dd0-a966-2f11ca26c50c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:35.008053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a8902-a739-4dd0-a966-2f11ca26c50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:35.009514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a8902-a739-4dd0-a966-2f11ca26c50c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:35.011144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 29/60] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:35.017090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:35.122363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f368dd-0f87-425c-9cd2-faa7c4af6c36 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:35.159286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111cf7-d365-4fb5-948e-d2400ed5a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:35.159940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111cf7-d365-4fb5-948e-d2400ed5a9a0 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:35.160227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111cf7-d365-4fb5-948e-d2400ed5a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:35.160503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111cf7-d365-4fb5-948e-d2400ed5a9a0 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:35.161189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111cf7-d365-4fb5-948e-d2400ed5a9a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:35.162636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111cf7-d365-4fb5-948e-d2400ed5a9a0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:35.246209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 32/61] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:33:35 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:38.380677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806413-388a-467c-9f15-4e7da48fa584 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.381565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806413-388a-467c-9f15-4e7da48fa584 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.382026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806413-388a-467c-9f15-4e7da48fa584 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.383910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 30/62] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:38.389248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851149a-49ad-41ad-ae70-18c42e4bbd8a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.390264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851149a-49ad-41ad-ae70-18c42e4bbd8a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.390691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851149a-49ad-41ad-ae70-18c42e4bbd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.421059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0851149a-49ad-41ad-ae70-18c42e4bbd8a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:38.422515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0851149a-49ad-41ad-ae70-18c42e4bbd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:38.492615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:38.517872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 33/63] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:38.552681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806413-388a-467c-9f15-4e7da48fa584 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:38.617456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac729362-de09-4b1f-b420-b26809c78381 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.618620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac729362-de09-4b1f-b420-b26809c78381 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.619114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac729362-de09-4b1f-b420-b26809c78381 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.620757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 34/64] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:38.627052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f628-c2cd-4173-94a0-c39ec4ec4a3d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.627482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f628-c2cd-4173-94a0-c39ec4ec4a3d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.627672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f628-c2cd-4173-94a0-c39ec4ec4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.666165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-52c8f628-c2cd-4173-94a0-c39ec4ec4a3d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:38.667402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-52c8f628-c2cd-4173-94a0-c39ec4ec4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:38.719412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806413-388a-467c-9f15-4e7da48fa584 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:38.745851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:38.758260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:38.759156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.759590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.760066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.760767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 35/65] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:38.762856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6585-5112-4401-aea4-aea13cc86039 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.763371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6585-5112-4401-aea4-aea13cc86039 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.763941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6585-5112-4401-aea4-aea13cc86039 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.765467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 36/66] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:38.770929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.771508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.772033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.773993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:38.779852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:38.781004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:38.781810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:38.782380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 31/67] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:38.788315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:38.796881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:38.798363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:38.876342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 37/68] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:38.883789 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:38.919683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bf4a1-1901-4c9d-82c2-73869deb2c56 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:38.952626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:38.959533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:38.960359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:38.960653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:38.960941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:38.968511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:38.968511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:38.968511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:38.977303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 32/69] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:38.978538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.015383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70accf3-bb17-4570-b5cb-a12ce8b77dce None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.035801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.053220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.053889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.054178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.054460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.067193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:39.072410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:39.073330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:39.074087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 38/70] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:33:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:39.074790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.100088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4162b9f-64c5-4dfc-8fe5-d90d2f0a5d7e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.140972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0de40a-a6f6-4874-876a-0140cb650573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.141532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de40a-a6f6-4874-876a-0140cb650573 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.141822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de40a-a6f6-4874-876a-0140cb650573 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.142165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de40a-a6f6-4874-876a-0140cb650573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.153591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0de40a-a6f6-4874-876a-0140cb650573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-0f0de40a-a6f6-4874-876a-0140cb650573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:39.159052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:39.160052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:39.160812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 33/71] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:39.162774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743664-e231-407d-a2fc-837eb5a49a14 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.163070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743664-e231-407d-a2fc-837eb5a49a14 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.163357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743664-e231-407d-a2fc-837eb5a49a14 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.165064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 34/72] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:39.170164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743664-e231-407d-a2fc-837eb5a49a14 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.209167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e66b5-9609-4c6b-a954-370d4e6c2f70 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.212994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.263553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59606e2-4b49-4dab-9595-c3f90e31cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.264132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59606e2-4b49-4dab-9595-c3f90e31cd7f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.264418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59606e2-4b49-4dab-9595-c3f90e31cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.264703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59606e2-4b49-4dab-9595-c3f90e31cd7f None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.273545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743664-e231-407d-a2fc-837eb5a49a14 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.278281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59606e2-4b49-4dab-9595-c3f90e31cd7f None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.279800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59606e2-4b49-4dab-9595-c3f90e31cd7f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.281097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.282992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 39/73] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:39.284325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9338b-5f65-4701-bc4a-1b22e431e4ac None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.284612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9338b-5f65-4701-bc4a-1b22e431e4ac None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.284883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9338b-5f65-4701-bc4a-1b22e431e4ac None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.286127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 40/74] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:39.286808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9338b-5f65-4701-bc4a-1b22e431e4ac None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.315930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.316567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.316860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.317145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.317883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:39.318199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.319609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604088-faa1-4b16-8413-8c218a7afaeb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.328736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 35/75] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:39.329971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.330265 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.330549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.348179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:39.349400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:39.398362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9338b-5f65-4701-bc4a-1b22e431e4ac None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.419363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 36/76] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:39.420077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.435465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.436431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.436431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.436728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.437430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:39.437733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.439196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed424-92bd-43e6-82e7-75228b72cae8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.448660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 41/77] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:39.450593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.450949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.451231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.470727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:39.472007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:39.490230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.528488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.532528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f6c0-8510-48ad-80ff-d79dbf9da9f1 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.543911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 42/78] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:39.556117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.567199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.567865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.568158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.568439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.641242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.642748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.660322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334693f-6f8a-4d02-a177-d5ca70f9add0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.697920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.698577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.698865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.699146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.700428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.701926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.703577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 43/79] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:39.703577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.733090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.746376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.751217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 37/80] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:39.752753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.810477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761aa7-1d1a-431b-bf0d-2b23841c793d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.845780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.846438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.846722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.847001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.848193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.849646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.851264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 44/81] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:39.856486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.858831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c35e2b-d0f6-484e-9a5a-2d2758129001 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.892486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:39.893139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:39.893428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:39.893712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:39.894890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:39.896363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:39.897980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 38/82] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:39.897980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:39.952307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.961784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a808a10-da41-4cee-8416-6a6dcf6e1296 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:39.964256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:39.999853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.000107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c0cb9-b332-4f73-934e-b56f4f834982 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.000520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.000809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.001087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.011708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:40.016720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:40.017558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:40.018668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 45/83] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:40.019490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.034466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.035108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.035398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.035678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.105468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.107467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.128854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8973-b480-4edb-bc8a-0558baf21575 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.163107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.164039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.164333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.164615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.165819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.167287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.169573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 46/84] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:40.172826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.172963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.194579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.210144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 39/85] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:40.212041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.277451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797c8c-bbea-4b50-a428-e02be122cae2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.315104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.315737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.316026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107da4-afb5-440e-8a8a-532dd2cd36c1 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.316133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.316396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.317099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.318573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.351321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.352036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.352325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.352604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.385313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.419967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.421462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.422744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 47/86] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:33:40 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:40.422744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.515834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.547667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 40/87] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:40.547667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.550317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b54a48-ab19-4ea3-9b3e-ce431ebfdb61 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.594120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.595339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.595339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.595339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.596148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:40.596466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.597864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.610133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 48/88] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:40.610835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.627135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.668289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768769ee-7874-4e60-a219-12d6175b7bf0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.725060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.725782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.726383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.726797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.727798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=51e8d5dea332458fad311662d57a861a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:40.728139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.730107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.737948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 41/89] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/role_assignments?user.id=51e8d5dea332458fad311662d57a861a&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:40.738372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cca80-c248-4157-b532-dfa950b1a1c6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.739293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.785135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.785889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.786110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.786396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.788167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.789675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.791536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 49/90] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:40.792406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.797414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.879555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32c86-b67a-4e3e-b340-fa924640f5f2 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.914114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:40.923516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.924253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.924549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.924846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.926416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.928213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.930129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 42/91] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:40.930947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:40.932373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07890f5-31b2-4885-ae9f-99cdbee2d532 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:40.971634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:40.972878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:40.973276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:40.973554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:40.974837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:40.976339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:40.977968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 50/92] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:40.978815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:41.055468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f89d-8829-4d34-a19a-8e3aec8db7ec None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:41.066764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:41.115339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ba4f-f187-4bd2-a7e2-1b3e7fee1dd6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:41.129378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:41.130017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:41.130307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:41.130586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:41.131400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] RBAC: Adding query filter params (role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=51e8d5dea332458fad311662d57a861a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:41.131716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:41.133269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:41.141315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 43/93] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/role_assignments?user.id=51e8d5dea332458fad311662d57a861a&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:41.142495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:41.213245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:41.213896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:41.214182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:41.214482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:41.216217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=0e22f2132e234963b03344d9530151a7) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:41.216535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:41.218057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:41.238029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 51/94] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:40 2022] GET /identity/v3/role_assignments?user.id=0e22f2132e234963b03344d9530151a7&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:41.297838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:41.329109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19397ce0-10f7-4a16-8441-a567c6c378aa None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:41.389809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:41.390465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:41.390757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:41.391040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:41.519670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:41.522058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:41.593866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:41.638912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 44/95] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:41.648932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:41.798219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049890e-62a8-474b-884f-3aff9187e53c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:41.835014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1e86-2c87-42b3-8c02-2a0b8cea7da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:41.835684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1e86-2c87-42b3-8c02-2a0b8cea7da3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:41.835997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1e86-2c87-42b3-8c02-2a0b8cea7da3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:41.836278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1e86-2c87-42b3-8c02-2a0b8cea7da3 None admin] PATH_INFO: `/v3/projects/48c77d4c007b4d86af7a05da082014b6` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:41.837491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc1e86-2c87-42b3-8c02-2a0b8cea7da3 None admin] RBAC: Authorizing `identity:get_project(project_id=48c77d4c007b4d86af7a05da082014b6)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:41.838984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc1e86-2c87-42b3-8c02-2a0b8cea7da3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:41.840782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 52/96] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:41 2022] GET /identity/v3/projects/48c77d4c007b4d86af7a05da082014b6 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:41.846850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:41.968604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ed88c-f621-4309-859d-85c36b31201c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:42.013538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:42.014171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:42.014466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:42.014749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:42.015562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=48c77d4c007b4d86af7a05da082014b6, user.id=51e8d5dea332458fad311662d57a861a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:42.015909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:42.017353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2318b3-62b8-4698-928e-a630aae91ccd None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:42.025017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 45/97] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:41 2022] GET /identity/v3/role_assignments?user.id=51e8d5dea332458fad311662d57a861a&scope.project.id=48c77d4c007b4d86af7a05da082014b6&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:43.338027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a68f1-9047-4767-a1b8-820de0770c97 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:43.338564 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a68f1-9047-4767-a1b8-820de0770c97 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:43.338639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a68f1-9047-4767-a1b8-820de0770c97 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:43.340487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 53/98] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:43.346643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:43.347186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:43.347186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:43.376826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:43.378060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:43.403812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:43.466475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 46/99] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:43.506657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a68f1-9047-4767-a1b8-820de0770c97 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:43.510703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:43.632610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a68f1-9047-4767-a1b8-820de0770c97 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:43.670585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700528-9fe3-425e-9396-59ed06dc4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:43.671252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700528-9fe3-425e-9396-59ed06dc4e10 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:43.671540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700528-9fe3-425e-9396-59ed06dc4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:43.671847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700528-9fe3-425e-9396-59ed06dc4e10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:43.683362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700528-9fe3-425e-9396-59ed06dc4e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-55700528-9fe3-425e-9396-59ed06dc4e10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:43.689963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:43.690804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:43.691788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 54/100] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:43.698589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:43.753506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15bc0-c477-40f5-8286-722785dcc09d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:43.753820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15bc0-c477-40f5-8286-722785dcc09d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:43.754079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15bc0-c477-40f5-8286-722785dcc09d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:43.755450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 55/101] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:33:43.760992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:43.761279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:43.761557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:43.796047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:43.797300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:43.917889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd31bde-71cd-49af-89f5-246b737d9399 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:43.961658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:43.978462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 56/102] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:43.982655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:43.994067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:43.994067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:43.994067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:43.994067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:43.994067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:43.994067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb8cd-d151-47a8-919c-39b62ade19cd None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:44.002003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 47/103] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:44.007727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.058747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378bcb-11e1-4f28-8a4a-c805ba8d299d None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.059097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378bcb-11e1-4f28-8a4a-c805ba8d299d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.059526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d378bcb-11e1-4f28-8a4a-c805ba8d299d None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.061247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 48/104] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:33:44.061773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d378bcb-11e1-4f28-8a4a-c805ba8d299d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.110340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:44.217817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2afe-8c39-43ff-bd64-689ed3ead80a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:44.252874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d378bcb-11e1-4f28-8a4a-c805ba8d299d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:44.258189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022893e7-aa3e-4269-ac26-19eb179c2c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:44.259206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022893e7-aa3e-4269-ac26-19eb179c2c30 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.259697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022893e7-aa3e-4269-ac26-19eb179c2c30 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.260209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022893e7-aa3e-4269-ac26-19eb179c2c30 None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.262333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022893e7-aa3e-4269-ac26-19eb179c2c30 None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:44.264622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022893e7-aa3e-4269-ac26-19eb179c2c30 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:44.267325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 57/105] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:44 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:44.269632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.270157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.270841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.296120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:44.297645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:44.303208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f0123-3440-4880-ac35-6063f8db3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:44.303854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f0123-3440-4880-ac35-6063f8db3744 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.304153 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f0123-3440-4880-ac35-6063f8db3744 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.304434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f0123-3440-4880-ac35-6063f8db3744 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.305777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f0123-3440-4880-ac35-6063f8db3744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:44.307395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f0123-3440-4880-ac35-6063f8db3744 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:44.309942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 49/106] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:44.311444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10327-9c48-47c2-b7df-92f381d9db5b None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.311943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10327-9c48-47c2-b7df-92f381d9db5b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.312373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10327-9c48-47c2-b7df-92f381d9db5b None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.313926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 50/107] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:44.318638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc10327-9c48-47c2-b7df-92f381d9db5b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.371891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:44.384920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 58/108] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:44.386283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.428352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:44.447175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc10327-9c48-47c2-b7df-92f381d9db5b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:44.487923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a74759-45d7-40de-86e3-3c83dfd1f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:44.488956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a74759-45d7-40de-86e3-3c83dfd1f488 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.489474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a74759-45d7-40de-86e3-3c83dfd1f488 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.489959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a74759-45d7-40de-86e3-3c83dfd1f488 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.491429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a74759-45d7-40de-86e3-3c83dfd1f488 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:44.493188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a74759-45d7-40de-86e3-3c83dfd1f488 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:44.495605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 51/109] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:44 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:44.497186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.497711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.498249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.516854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa91e-4d24-49aa-8ee6-a3fff4927bb2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:44.520808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:44.522321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:44.560925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:44.561675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.561971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.562251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.562946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:44.564461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:44.611646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 52/110] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:44.617877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.655416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 59/111] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:33:44 2022] POST /identity/v3/projects => generated 302 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:44.664891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.735589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:44.740096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:44.758482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b6548-ee38-4731-aea9-6b7227385ca3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:44.813716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ea36a-40fa-49d1-92e4-6bed34792a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:44.814384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ea36a-40fa-49d1-92e4-6bed34792a55 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.814674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ea36a-40fa-49d1-92e4-6bed34792a55 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.814943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ea36a-40fa-49d1-92e4-6bed34792a55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.825085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6bfb8-8e74-4869-87d8-10b9412d0853 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:44.829997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ea36a-40fa-49d1-92e4-6bed34792a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-608ea36a-40fa-49d1-92e4-6bed34792a55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:44.835048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:44.835943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:44.836702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 53/112] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:44.837474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4aeaf-86c8-44b0-afb7-bfb6a5db32c9 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.837769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4aeaf-86c8-44b0-afb7-bfb6a5db32c9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.838049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4aeaf-86c8-44b0-afb7-bfb6a5db32c9 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.839560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 54/113] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:44.840907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4aeaf-86c8-44b0-afb7-bfb6a5db32c9 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.875547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3feb5-33fb-499f-86a9-92802d75fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:44.876302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3feb5-33fb-499f-86a9-92802d75fa9e None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.876598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3feb5-33fb-499f-86a9-92802d75fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.876914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3feb5-33fb-499f-86a9-92802d75fa9e None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/51e8d5dea332458fad311662d57a861a/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.879512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3feb5-33fb-499f-86a9-92802d75fa9e None admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8c574b54d4a55bf9d20699942aa77, user_id=51e8d5dea332458fad311662d57a861a, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:44.881159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3feb5-33fb-499f-86a9-92802d75fa9e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:44.943551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 60/114] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:44 2022] PUT /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/51e8d5dea332458fad311662d57a861a/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:44.945165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29510-1e0a-408e-a696-b3afd053204a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:44.945540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29510-1e0a-408e-a696-b3afd053204a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:44.945744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29510-1e0a-408e-a696-b3afd053204a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:44.947103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 61/115] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:44.947993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29510-1e0a-408e-a696-b3afd053204a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:44.974305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4aeaf-86c8-44b0-afb7-bfb6a5db32c9 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.030133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183cf1a-2f8b-409b-b2b8-86d870115a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.031527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183cf1a-2f8b-409b-b2b8-86d870115a79 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.032070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183cf1a-2f8b-409b-b2b8-86d870115a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.033130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183cf1a-2f8b-409b-b2b8-86d870115a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.051308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183cf1a-2f8b-409b-b2b8-86d870115a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2183cf1a-2f8b-409b-b2b8-86d870115a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:45.058082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:45.059511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:45.060433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:45.063517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 55/116] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:45.065497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.065963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.066654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.077641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.093587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:45.095530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:45.110628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29510-1e0a-408e-a696-b3afd053204a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.114781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.160027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.161179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.161179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.161360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.162119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:45.162473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:45.165112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db644-db63-4664-a6b0-01d9ce6caa31 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:45.176685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 62/117] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:45.178022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.178318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.178603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.186789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 56/118] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:45.187869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.213742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:45.215555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:45.306275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 63/119] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:45.307288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.329681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785720-4432-461c-b53e-5b7dcf3a124c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.371609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.372644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.373104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.373553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.374513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:45.375055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:45.376698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:45.378653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.389281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 57/120] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:45.394822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.416615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.423349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d8579-0f7d-4343-a9cf-3bed6f16c5a1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.462140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.462526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.462820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.463162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] PATH_INFO: `/v3/users/2ce46abca9694817b7e2eabecf52cf2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.478312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] RBAC: Authorizing `identity:get_user(user_id=2ce46abca9694817b7e2eabecf52cf2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:45.479978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:45.482279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 64/121] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/users/2ce46abca9694817b7e2eabecf52cf2b => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:45.486779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.519679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379077b2-7c0f-440e-82af-e50c4fc2b8ba None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.562687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.563672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.564134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.564626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.577545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:45.583122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:45.584205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:45.585053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:45.587065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 58/122] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:45.588081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.601604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f196324-35ae-4d15-abc5-40092b4fdba9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.638070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.638518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.638808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.639094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.650337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:45.655175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:45.656663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:45.657683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:45.658508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 65/123] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:45.659139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.677901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.709466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e46c1-1ca3-41c5-893c-ff6d95cb0b64 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.749324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.750284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.750769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.751219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.752716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:45.754423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:45.756395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 59/124] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:45.762360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:45.777784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942142-7645-49f7-84f1-b42ab1e149cb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.817379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.817983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.818277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.818561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.871348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4018a91-8557-4669-9b68-4a8dae3dbd78 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:45.901898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.902099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:45.904731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:45.919471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:45.920808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:45.921243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:45.921664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:45.922776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:45.923501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:45.923665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:45.925380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:45.937538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 60/125] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:45.941506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.033162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 66/126] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:46.033162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.095538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31adfc-6ff7-47be-abbe-66bcfe6b2b81 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.133136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.134179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.134696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.135179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.136210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:46.137274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.138951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.148716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 61/127] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.150021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.190197 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236bdc-aa4a-439a-9a45-7110895f1ae9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.207429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:46.208377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:46.233242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.233901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.234191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.234478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.235695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.237193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.238881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 67/128] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.244326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.268487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda0075-9f87-4170-9618-ac742f906437 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.313285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.314083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.314523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.314937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.316397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.318012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.320026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 62/129] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.320787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.356552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75b8a-ef77-400e-8d62-f1453c3bc5d2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.393339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.394001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.394291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.394572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.395775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.397237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.404153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 68/130] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.405073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.439712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e85668-40c9-4ebd-88bf-96cf0ced8f39 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.458252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:46.460557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:46.478083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.478762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.479053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.479340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.480745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.482224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.484241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 63/131] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.484902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.521333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f20998-2bd2-4f81-992e-7e359aa46679 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.561233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.561979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.562370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.562659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/0e22f2132e234963b03344d9530151a7/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.564946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8c574b54d4a55bf9d20699942aa77, user_id=0e22f2132e234963b03344d9530151a7, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.566551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.609771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae6298-2bcc-42e9-bb58-3ff00ad9241e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.648515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.649266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.649562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.649849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.652065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.654254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.656124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 64/132] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.656920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.696484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 69/133] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:46 2022] PUT /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/0e22f2132e234963b03344d9530151a7/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:46.697566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.734840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:46.800388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f252c-02ab-4048-b27b-c4d7f9e102a4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.846763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.847414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.847707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.848020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.848984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] RBAC: Adding query filter params (role.id=3d5a74c46b9e48b989499e004a8a412b, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=2ce46abca9694817b7e2eabecf52cf2b) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:46.849504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.851016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.860764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 65/134] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/role_assignments?user.id=2ce46abca9694817b7e2eabecf52cf2b&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=3d5a74c46b9e48b989499e004a8a412b => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.862301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:46.910143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e8444-7402-4586-b1a4-9dfbfff12116 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:46.923902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:46.971633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300c3e9-757e-4f61-bad3-eb992b8ae0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:46.972717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300c3e9-757e-4f61-bad3-eb992b8ae0f5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.973263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300c3e9-757e-4f61-bad3-eb992b8ae0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.973807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300c3e9-757e-4f61-bad3-eb992b8ae0f5 None admin] PATH_INFO: `/v3/projects/48c77d4c007b4d86af7a05da082014b6` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.975967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300c3e9-757e-4f61-bad3-eb992b8ae0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=48c77d4c007b4d86af7a05da082014b6)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:46.977942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300c3e9-757e-4f61-bad3-eb992b8ae0f5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:46.981859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 70/135] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:46 2022] GET /identity/v3/projects/48c77d4c007b4d86af7a05da082014b6 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:46.988950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823941-b3d6-47d4-85d1-094c2d6451f8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:46.989520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823941-b3d6-47d4-85d1-094c2d6451f8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:46.990014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823941-b3d6-47d4-85d1-094c2d6451f8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:46.991733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 71/136] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:46.994041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823941-b3d6-47d4-85d1-094c2d6451f8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:47.025321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d37a5-53f0-4a69-af84-082e5a650338 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:47.051569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:47.077046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44dd1f-c896-4d53-90e4-138d21a8f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:47.078007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44dd1f-c896-4d53-90e4-138d21a8f046 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.078675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44dd1f-c896-4d53-90e4-138d21a8f046 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.079576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44dd1f-c896-4d53-90e4-138d21a8f046 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/51e8d5dea332458fad311662d57a861a/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.082327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44dd1f-c896-4d53-90e4-138d21a8f046 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8c574b54d4a55bf9d20699942aa77, user_id=51e8d5dea332458fad311662d57a861a, role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:47.084595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44dd1f-c896-4d53-90e4-138d21a8f046 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:47.129803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823941-b3d6-47d4-85d1-094c2d6451f8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:47.171021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a45cb-3f4c-4851-9aa6-5081fcd07ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:47.171904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a45cb-3f4c-4851-9aa6-5081fcd07ebd None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.172193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a45cb-3f4c-4851-9aa6-5081fcd07ebd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.172473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a45cb-3f4c-4851-9aa6-5081fcd07ebd None admin] PATH_INFO: `/v3/projects/48c77d4c007b4d86af7a05da082014b6/users/51e8d5dea332458fad311662d57a861a/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.174619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a45cb-3f4c-4851-9aa6-5081fcd07ebd None admin] RBAC: Authorizing `identity:create_grant(project_id=48c77d4c007b4d86af7a05da082014b6, user_id=51e8d5dea332458fad311662d57a861a, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:47.176184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a45cb-3f4c-4851-9aa6-5081fcd07ebd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:47.188310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 66/137] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:46 2022] PUT /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/51e8d5dea332458fad311662d57a861a/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:47.188310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.188310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.188310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.213715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:47.216191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:47.286422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 72/138] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:46 2022] PUT /identity/v3/projects/48c77d4c007b4d86af7a05da082014b6/users/51e8d5dea332458fad311662d57a861a/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:47.287468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a50a-c631-41fd-a548-8c056a68a222 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.287778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a50a-c631-41fd-a548-8c056a68a222 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.288668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6a50a-c631-41fd-a548-8c056a68a222 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.289881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 73/139] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:47.295994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.296285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.296551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.314869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 67/140] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:47.339510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:47.341677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:47.356842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:47.416264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:47.498331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 74/141] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:47.541624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:47.582555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd9678-1bd3-4e34-a676-43fadbcac721 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:47.608518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:47.634689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:47.636226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.636716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.637285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.639284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:47.641057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:47.643249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 68/142] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:47.656827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:47.683272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a94ce-e013-4e34-b898-a3a8d4ece6e3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:47.725906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:47.726729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.727020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.727299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.740102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:47.745549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:47.746470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:47.747241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 75/143] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:33:47.755194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:47.821343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:47.883789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8541b37-a5fd-48dd-a486-0f9995dca6a8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:47.962437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:47.963005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:47.963300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:47.963585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:47.964333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:47.966423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:48.028482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2031637-b86b-4474-a1b7-879829fdca84 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:48.069226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:48.069965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:48.070264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:48.070584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:48.071386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:48.071701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:48.073309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:48.083770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 76/144] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:48.089362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:48.112718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 69/145] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:33:47 2022] POST /identity/v3/users => generated 283 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:48.231926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:48.242715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8d276-c5ba-4428-a07b-6f3eb058355d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:48.284355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:48.285015 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:48.285305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:48.287812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:48.287812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:48.288604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:48.290547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 77/146] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:48 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:48.298708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:48.332259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:48.416368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c8b8-7a8e-44b5-a0e5-0a73e181d0bd None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:48.454992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:48.455630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:48.455956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:48.456241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:48.532900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:48.534386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:48.567016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:48.642443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 70/147] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:48.648080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:48.757255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31910287-2360-4b22-b473-83776448d8d4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:48.793797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c33d27-624b-48b7-a96d-c367e0109174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:48.794377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c33d27-624b-48b7-a96d-c367e0109174 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:48.794664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c33d27-624b-48b7-a96d-c367e0109174 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:48.794947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c33d27-624b-48b7-a96d-c367e0109174 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:48.796246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c33d27-624b-48b7-a96d-c367e0109174 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:48.797719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c33d27-624b-48b7-a96d-c367e0109174 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:48.799409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 78/148] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:48 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:48.805368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:48.914061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e3de-35cd-4415-9517-d5bc022ed63d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:48.948151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:48.956616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:48.957264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:48.960429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:48.960429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:48.960429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=51e8d5dea332458fad311662d57a861a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:48.960429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:48.961027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2dd7f-41c8-4790-8986-e07e27dcaf9d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:48.968157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 71/149] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:48 2022] GET /identity/v3/role_assignments?user.id=51e8d5dea332458fad311662d57a861a&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:49.622992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4ad2-908a-447f-a20c-0b4a70100505 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:49.623342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4ad2-908a-447f-a20c-0b4a70100505 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:49.623556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4ad2-908a-447f-a20c-0b4a70100505 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:49.625529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 79/150] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:49.630950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ceaaa-a05a-4265-9c7a-3a2010371376 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:49.631556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ceaaa-a05a-4265-9c7a-3a2010371376 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:49.632082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ceaaa-a05a-4265-9c7a-3a2010371376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:49.653981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-910ceaaa-a05a-4265-9c7a-3a2010371376 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:49.656125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-910ceaaa-a05a-4265-9c7a-3a2010371376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:49.755919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 72/151] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:49.797344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4ad2-908a-447f-a20c-0b4a70100505 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:49.837672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fc4a5-578c-4274-b7d7-9b04cd83a7cb None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:49.837988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fc4a5-578c-4274-b7d7-9b04cd83a7cb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:49.838329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fc4a5-578c-4274-b7d7-9b04cd83a7cb None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:49.839854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 73/152] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:33:49.848325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:49.848630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:49.849050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:49.849497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:49.882961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:49.884465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:49.995231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 74/153] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:50.000729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4ad2-908a-447f-a20c-0b4a70100505 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.037109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.037819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.038103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.038640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.047345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.051630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:50.058051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:50.059346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:50.060147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 80/154] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:50.065146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.126573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:50.188067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ee8a-b32b-4ba1-8a21-dd558c7d7afa None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.252935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:50.268080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983687e4-d756-46ff-8aa8-2108d47b6549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.268791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983687e4-d756-46ff-8aa8-2108d47b6549 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.269088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983687e4-d756-46ff-8aa8-2108d47b6549 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.269374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983687e4-d756-46ff-8aa8-2108d47b6549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.292332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615c493-26f4-4f52-ade5-7c8d2dae1c43 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.309052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983687e4-d756-46ff-8aa8-2108d47b6549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-983687e4-d756-46ff-8aa8-2108d47b6549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:50.314139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:50.315101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:50.315939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 75/155] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:50.317437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b046-321c-4bfd-aab4-e7dcf86123bb None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.317733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b046-321c-4bfd-aab4-e7dcf86123bb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.318018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b046-321c-4bfd-aab4-e7dcf86123bb None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.319301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 76/156] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:50.328180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.328469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.328752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.351241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.352286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.352805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.353294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.354218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:50.354731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:50.356953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:50.362593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:50.364941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:50.379819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 81/157] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:50.380977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.452482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 77/158] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:50.453652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.532179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:50.560597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186a45-c09c-4307-9364-cf42ff5b4898 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.611659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c836-eb15-42ef-a932-11dd294900b7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.636555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.637254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.637544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.637821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.638550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:50.638854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:50.643780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:50.655786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 82/159] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:50.655786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.681447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.682821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.683368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.684380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] PATH_INFO: `/v3/users/2ce46abca9694817b7e2eabecf52cf2b` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.684527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:50.689211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] RBAC: Authorizing `identity:get_user(user_id=2ce46abca9694817b7e2eabecf52cf2b)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:50.689211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:50.689211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 78/160] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/users/2ce46abca9694817b7e2eabecf52cf2b => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:50.689837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.799561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02de965-cbd5-4bc4-b786-8be856e57b9a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.816148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:50.840688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.841742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.842154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.842609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] PATH_INFO: `/v3/users/0e22f2132e234963b03344d9530151a7` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.844292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0e22f2132e234963b03344d9530151a7)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:50.846444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:50.848677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 79/161] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/users/0e22f2132e234963b03344d9530151a7 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:50.849995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.866535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae51582-c0d0-436e-9847-5143a18703d4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:50.928774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:50.929584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:50.930667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:50.931045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:50.955177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:50.960552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:50.961386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:50.962557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 83/162] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:50.963260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:50.998373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc51a-d9cb-4f45-85ce-9f1cd31558b5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:51.045962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0374e64-91e9-47d9-b564-7875f4c675e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:51.046638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0374e64-91e9-47d9-b564-7875f4c675e2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.046926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0374e64-91e9-47d9-b564-7875f4c675e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.047209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0374e64-91e9-47d9-b564-7875f4c675e2 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.048443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0374e64-91e9-47d9-b564-7875f4c675e2 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:51.049992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0374e64-91e9-47d9-b564-7875f4c675e2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:51.051960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 80/163] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:51.053322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23730a-0b20-416d-8100-ef5c3013154e None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.053430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23730a-0b20-416d-8100-ef5c3013154e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.053667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23730a-0b20-416d-8100-ef5c3013154e None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.054961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 81/164] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:51.055783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23730a-0b20-416d-8100-ef5c3013154e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:51.088165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:51.138122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:51.145581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55837b-96c4-41bd-b012-e77d6508d31c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:51.205823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:51.206460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.206745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.207023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.235389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23730a-0b20-416d-8100-ef5c3013154e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:51.295044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:51.295693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.296004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.296288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.297029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:51.297341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:51.307620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9df671-9f2b-4e01-87d5-9fde319dd0c9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:51.307620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 82/165] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:33:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:51.309808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.310005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.310493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.331465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:51.333287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:51.344254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:51.345654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:51.417322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:51.466399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 84/166] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:51.474767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:51.507008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 83/167] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:51.512591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:51.602576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:51.671503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3baf-9736-4904-a2c6-e51414b8c15b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:51.711105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:51.712674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.713196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.713675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.713905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08344614-cbe3-43cd-931e-84cd61ecc08c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:51.716238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:51.717898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:51.719805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 84/168] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:51 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:51.724726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:51.789217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:51.791603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.792108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.793692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/2ce46abca9694817b7e2eabecf52cf2b/roles/3d5a74c46b9e48b989499e004a8a412b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.797336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8c574b54d4a55bf9d20699942aa77, user_id=2ce46abca9694817b7e2eabecf52cf2b, role_id=3d5a74c46b9e48b989499e004a8a412b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:51.799138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:51.856395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faaeae-578b-4d42-8620-c7154cd17919 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:51.868146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:51.883918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 85/169] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:51 2022] PUT /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/users/2ce46abca9694817b7e2eabecf52cf2b/roles/3d5a74c46b9e48b989499e004a8a412b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:51.885662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:51.908662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:51.909389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:51.909683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:51.913812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:51.916534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:51.918728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:51.920914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 85/170] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:51 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:51.921753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:51.947075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:52.061213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8c1c-3339-4e01-a2c8-43bcb7390ffc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.131879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.132752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.133166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.133582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.135007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437acf8e-8b7b-4e59-9d62-82df30efa3f8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.145588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:52.150771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:52.151639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:52.154331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:52.157076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 86/171] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:52.158264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.176490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2904-28c8-4a60-ae9f-501867a34f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.177025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2904-28c8-4a60-ae9f-501867a34f31 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.177391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2904-28c8-4a60-ae9f-501867a34f31 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.177749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2904-28c8-4a60-ae9f-501867a34f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.252372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2904-28c8-4a60-ae9f-501867a34f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:52.254000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2904-28c8-4a60-ae9f-501867a34f31 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:52.260718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:52.279421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb06a9-5995-4f69-95ff-39aec4ee265a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.283018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:52.318523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.319414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.319921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.320354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.321392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=0e22f2132e234963b03344d9530151a7) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:52.321862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:52.323485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc637a-5c7a-4449-a000-e0c33f147ea5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:52.330441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 87/172] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/role_assignments?user.id=0e22f2132e234963b03344d9530151a7&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:52.337470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3ed8-600f-48f1-9ea3-c228e62faba8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.337992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3ed8-600f-48f1-9ea3-c228e62faba8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.338443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3ed8-600f-48f1-9ea3-c228e62faba8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.340460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 88/173] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:52.341438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3ed8-600f-48f1-9ea3-c228e62faba8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.401690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 86/174] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:52.403489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.403907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.404196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.422938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:52.424183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:52.500868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 87/175] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:52.501740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.518751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:52.521348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3ed8-600f-48f1-9ea3-c228e62faba8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.563152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.564271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.564843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.565317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.566352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:52.566899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:52.568725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928a4dc-b722-45bd-8924-929619cc18f4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:52.579984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 89/176] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:52.581853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cce02-9e52-4b63-88e3-7d52f29e691b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.582366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cce02-9e52-4b63-88e3-7d52f29e691b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.582838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cce02-9e52-4b63-88e3-7d52f29e691b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.584867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 90/177] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:52.585990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cce02-9e52-4b63-88e3-7d52f29e691b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.608525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:52.643486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d6b7-b82d-4b86-b2c1-77469954aa37 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.697520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.698274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.698532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.699406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.700960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:52.703131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:52.705802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 88/178] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:52.707134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.711057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cce02-9e52-4b63-88e3-7d52f29e691b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.748130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda55ca-9d1a-4fbc-8237-8ab40a172ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.749533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda55ca-9d1a-4fbc-8237-8ab40a172ce4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.750391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda55ca-9d1a-4fbc-8237-8ab40a172ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.751146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda55ca-9d1a-4fbc-8237-8ab40a172ce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.764871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda55ca-9d1a-4fbc-8237-8ab40a172ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6dda55ca-9d1a-4fbc-8237-8ab40a172ce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:52.770752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:52.771682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:52.772539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:52.776894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 91/179] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:52.776894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e0ad-af60-445c-b5be-a1e8e093faa7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.776894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e0ad-af60-445c-b5be-a1e8e093faa7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.776894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067e0ad-af60-445c-b5be-a1e8e093faa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.797063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:52.807080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a067e0ad-af60-445c-b5be-a1e8e093faa7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:52.808969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a067e0ad-af60-445c-b5be-a1e8e093faa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:52.822397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7475b8-d82b-425b-9262-a04662c728ea None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:52.860821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:52.861483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.861771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.862062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] PATH_INFO: `/v3/users/51e8d5dea332458fad311662d57a861a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.863259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] RBAC: Authorizing `identity:get_user(user_id=51e8d5dea332458fad311662d57a861a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:52.864732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:52.866543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 89/180] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/users/51e8d5dea332458fad311662d57a861a => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:52.867124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.889430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 92/181] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:52.890739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bfed-d771-4024-b4e8-bbb2cafdf411 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:52.891034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bfed-d771-4024-b4e8-bbb2cafdf411 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:52.891323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bfed-d771-4024-b4e8-bbb2cafdf411 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:52.892707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 93/182] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:52.897538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3bfed-d771-4024-b4e8-bbb2cafdf411 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:52.916048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.011290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc079-0467-464d-a046-5397a7fa68ea None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.047903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.048538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.048871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.049154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.049961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] RBAC: Adding query filter params (role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=51e8d5dea332458fad311662d57a861a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:53.050279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.051775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.055604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3bfed-d771-4024-b4e8-bbb2cafdf411 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.058233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 90/183] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/role_assignments?user.id=51e8d5dea332458fad311662d57a861a&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:53.063794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.078680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.103303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.104352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.104770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.105431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.106013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:53.106418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.108781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd7186-c867-4026-a45c-500130da43fe None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.126027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 94/184] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:53.126027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.126027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.126027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.146997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:53.148947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:53.221035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05e025-8f75-40d7-953f-06651a8e57cc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.240816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.248160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 95/185] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:53.249299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.267957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.269068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.269573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.270207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.368692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.370159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.379067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.388431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78215b4b-beac-47dc-be47-e490595ab6cb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.425224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.425874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.426161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.426466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.438644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:53.443886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:53.444810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:53.445658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 96/186] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:53.446290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.487933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 91/187] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:53.489165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.513611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.557727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad6a4-7042-48ec-8a6d-f6f072632a14 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.593661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.594292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.594573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.594866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] PATH_INFO: `/v3/users/07c70a93a202429393c91efa68fab0a3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.603416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29ff12-5cf8-44ee-8b2e-aa07f0d6a9c5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.610080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] RBAC: Authorizing `identity:get_user(user_id=07c70a93a202429393c91efa68fab0a3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.611543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.612569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.613224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 97/188] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/users/07c70a93a202429393c91efa68fab0a3 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:53.613983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.644330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.645164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.646469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.646746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.648309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.649759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.656285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 92/189] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:53.656285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.733523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8d26b-a7ea-4949-895c-4a08f4e1bd05 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.750962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.760578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25275-f9f8-4a61-b4f0-2bea3bed21dc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.769029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.769656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.769947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.770228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.770958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:53.771271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.772681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.786184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 98/190] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:53.787053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.797539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.798190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.798479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.798756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] PATH_INFO: `/v3/projects/48c77d4c007b4d86af7a05da082014b6` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.799961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] RBAC: Authorizing `identity:get_project(project_id=48c77d4c007b4d86af7a05da082014b6)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.801393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.803218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 93/191] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/projects/48c77d4c007b4d86af7a05da082014b6 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:53.803825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:53.857612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:53.899596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59b10-135b-4f4f-949f-21e0b43ba963 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.921937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1d5da-8b1b-44cb-8f19-9cca7eb89a0b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:53.937494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.938502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.938944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.939232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.958727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:53.959353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:53.959640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:53.959949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:53.960643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:53.962100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:53.988727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.010388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:54.012080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:54.073449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 94/192] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:33:53 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:33:54.074719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.133235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 99/193] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:54.133910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.221263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.229055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79370bb1-114e-4c6e-a7cc-9d05c5c6eee6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:54.230797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.260124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9456316-3085-49f7-9066-ed94a5eaac85 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:54.275658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:54.278322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.278780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.279548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] PATH_INFO: `/v3/users/07c70a93a202429393c91efa68fab0a3` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.281033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] RBAC: Authorizing `identity:get_user(user_id=07c70a93a202429393c91efa68fab0a3)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:54.282670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:54.284658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 95/194] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/users/07c70a93a202429393c91efa68fab0a3 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:54.285647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.306871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:54.307724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.308097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.308369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.309180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=48c77d4c007b4d86af7a05da082014b6, user.id=51e8d5dea332458fad311662d57a861a) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:54.309490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:54.310933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:54.321798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 100/195] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/role_assignments?user.id=51e8d5dea332458fad311662d57a861a&scope.project.id=48c77d4c007b4d86af7a05da082014b6&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:54.324213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.430602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1073965-a08c-41bd-9afe-860d7018acc6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:54.467226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faf10-fe1e-4535-83ac-4a46209d1e7f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:54.475358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d8108-ea46-40fb-9e4b-eeaf3452cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:54.476089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d8108-ea46-40fb-9e4b-eeaf3452cf40 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.476399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d8108-ea46-40fb-9e4b-eeaf3452cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.476701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d8108-ea46-40fb-9e4b-eeaf3452cf40 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.478001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d8108-ea46-40fb-9e4b-eeaf3452cf40 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:54.480259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d8108-ea46-40fb-9e4b-eeaf3452cf40 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:54.482258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 96/196] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:54.487790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c9bf-711b-4254-a8f9-b673155193cd None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.487790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c9bf-711b-4254-a8f9-b673155193cd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.487790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c9bf-711b-4254-a8f9-b673155193cd None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.487790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 97/197] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:54.492446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.492760 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.493043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.517760 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:54.518965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:54.521355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:54.522450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.522807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.523164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.538803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.552576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.608653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 98/198] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:54.609561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.631367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:54.632889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:54.737096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c1b6e-a6a9-4648-816e-c4abcecd8179 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:54.771483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 101/199] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:33:54.772446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.780600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:54.781234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.781966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.782252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:54.783060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=f82d09c494574602ae59009847734816, user.id=07c70a93a202429393c91efa68fab0a3) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:54.783374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:54.785645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:54.793672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 99/200] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/role_assignments?user.id=07c70a93a202429393c91efa68fab0a3&scope.project.id=f82d09c494574602ae59009847734816&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:54.794499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:54.849562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.866040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:54.939936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592acd36-ed97-467a-8f6a-86596773e9f1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:54.993334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:54.994012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:54.994304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:54.994584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:55.011799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:55.013414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:55.014240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:33:55.015074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:55.019613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 102/201] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:55.020858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:55.024962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21da13-7d71-4e9b-a530-d7b91de5c1ed None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:55.184722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d86fa-7e7b-483a-ab07-b1889299d8db None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:55.193672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:55.194347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:55.194701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:55.194987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:55.200549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:55.202019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:55.203923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 100/202] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:54 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:55.210802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:55.223231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:55.223893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:55.224180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:55.224548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:55.225280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:55.225635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:55.227068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:55.240214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:55.241894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 103/203] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:55.247574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:55.405844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41334-7470-44d9-ba99-88969cf41cb0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:55.407875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a8334-8e48-45c3-9421-f96f77169862 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:55.408443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:55.456508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:55.457158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:55.457445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:55.457725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] PATH_INFO: `/v3/users/2ce46abca9694817b7e2eabecf52cf2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:55.459116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] RBAC: Authorizing `identity:get_user(user_id=2ce46abca9694817b7e2eabecf52cf2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:55.459741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:55.460470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:55.460645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:55.460753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:55.461029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:55.461839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] RBAC: Adding query filter params (role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=f82d09c494574602ae59009847734816, user.id=07c70a93a202429393c91efa68fab0a3) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:55.462162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:55.462262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 104/204] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:55 2022] GET /identity/v3/users/2ce46abca9694817b7e2eabecf52cf2b => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:55.463997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:55.468603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:55.471387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 101/205] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:55 2022] GET /identity/v3/role_assignments?user.id=07c70a93a202429393c91efa68fab0a3&scope.project.id=f82d09c494574602ae59009847734816&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:55.528734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:55.630423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f433d6-4f53-4f85-90a1-f7fff224c6ec None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:55.669042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:55.669691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:55.669980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:55.670257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:55.767911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:55.769409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:55.802209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:55.877221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 105/206] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:33:55.882771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:56.028359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cca5e-d0ef-436f-8571-2721fabc267c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:56.079462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2fb96-37d8-4e43-8fe9-657b6ce301e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:56.080127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2fb96-37d8-4e43-8fe9-657b6ce301e1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.080421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2fb96-37d8-4e43-8fe9-657b6ce301e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.080705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2fb96-37d8-4e43-8fe9-657b6ce301e1 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.081979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2fb96-37d8-4e43-8fe9-657b6ce301e1 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:56.083529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2fb96-37d8-4e43-8fe9-657b6ce301e1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:56.085670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 102/207] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:55 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:56.091601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:56.245203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef17a1-5fc2-4091-b598-9df49d387390 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:56.282967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:56.288589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:56.289224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.289505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.289838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.290652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] RBAC: Adding query filter params (role.id=3d5a74c46b9e48b989499e004a8a412b, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77, user.id=2ce46abca9694817b7e2eabecf52cf2b) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:56.290962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:56.293044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c05901-bebb-4e6c-a908-73239f7cf32a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:56.300012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 106/208] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:56 2022] GET /identity/v3/role_assignments?user.id=2ce46abca9694817b7e2eabecf52cf2b&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=3d5a74c46b9e48b989499e004a8a412b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:56.610503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ceaa7-983f-44c9-9fa9-97cc78471636 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.610973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ceaa7-983f-44c9-9fa9-97cc78471636 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.611100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ceaa7-983f-44c9-9fa9-97cc78471636 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.612468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 103/209] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:56.617766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdbbf-795c-4841-ba88-70ba0a72749b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.618055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdbbf-795c-4841-ba88-70ba0a72749b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.618472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdbbf-795c-4841-ba88-70ba0a72749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.638081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3afbdbbf-795c-4841-ba88-70ba0a72749b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:56.639323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3afbdbbf-795c-4841-ba88-70ba0a72749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:56.723871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 107/210] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:56.731732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96be01-7f61-4986-9926-7593175a9938 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.732048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96be01-7f61-4986-9926-7593175a9938 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.732336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96be01-7f61-4986-9926-7593175a9938 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.733989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 104/211] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:56.739543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.739863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.740161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.747414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96be01-7f61-4986-9926-7593175a9938 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:56.761624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:56.763297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:56.780203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:56.837154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 108/212] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:56.863121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96be01-7f61-4986-9926-7593175a9938 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:56.863300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:56.901814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:56.902535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:56.902944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:56.903237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:56.915933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:56.922749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:56.923628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:56.924432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 105/213] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:33:56.932467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:56.936699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:56.987679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f629b-1601-4d1c-ad81-82d1b10f6845 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.025341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.025982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.026269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.027076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.028666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.029736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.031689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 109/214] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:33:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:57.036936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.056162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.068451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d913-8f1c-422b-813a-1b4f77f02fde None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.107880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.108906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.109284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.109577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.110924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:57.111251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.114275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.123526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 106/215] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:57.128797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.153648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302d6b3-c2da-4f23-8c00-61362996ff01 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.180584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.192035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9053-b914-4e06-9aef-0ddf7f228dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.192733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9053-b914-4e06-9aef-0ddf7f228dfd None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.194606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9053-b914-4e06-9aef-0ddf7f228dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.194606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9053-b914-4e06-9aef-0ddf7f228dfd None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.194606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee9053-b914-4e06-9aef-0ddf7f228dfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.195693 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee9053-b914-4e06-9aef-0ddf7f228dfd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.248596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d67c3a-aa34-461a-a509-55ff1681a931 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.291523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 110/216] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:33:57 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:33:57.292913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.293704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.293986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.294261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] PATH_INFO: `/v3/users/7e11e220b6b74c059ee7e5ae04874e38` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.313820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f25c-ea86-472b-ad9c-a91aa7cb04a5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.314164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f25c-ea86-472b-ad9c-a91aa7cb04a5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.314387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514f25c-ea86-472b-ad9c-a91aa7cb04a5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.320069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 111/217] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:57.322534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] RBAC: Authorizing `identity:get_user(user_id=7e11e220b6b74c059ee7e5ae04874e38)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.323112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.324387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.324704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.324867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.331575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 107/218] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/users/7e11e220b6b74c059ee7e5ae04874e38 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:57.333161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.347218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.350685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:57.351942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:57.431739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 112/219] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:33:57.452460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274908b0-1cab-4c85-a6ab-d3e9a0631188 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.458340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.507951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.507951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.508236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.508447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.582951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024b7dc-4869-46fa-9a0a-7e62c983aeec None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.597003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.613650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.615229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.628555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.632795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.633626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.633914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.634189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.647080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:57.653108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:57.656388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:33:57.657164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 113/220] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:33:57.663978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.750976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 108/221] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:33:57.758086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.800766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74457eec-48f3-4ab0-b1e9-6653d57d159d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.842418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.843155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.843441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.843718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.844483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:57.844789 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.846167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.860936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 114/222] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:57.862847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:57.885411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded7aa-f5c6-4689-b3b8-3d3059941f59 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:57.895456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.909314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:57.938349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:57.939002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:57.939283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:57.939554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:57.942612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:57.946381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:57.948124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 109/223] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:33:57.954199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:58.050680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f116be-9d10-4be4-94ed-0fb6dabe386b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:58.097349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:58.098000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.098285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.098629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] PATH_INFO: `/v3/users/07c70a93a202429393c91efa68fab0a3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.099885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] RBAC: Authorizing `identity:get_user(user_id=07c70a93a202429393c91efa68fab0a3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:58.101316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:58.103233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 115/224] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/users/07c70a93a202429393c91efa68fab0a3 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:58.109918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:58.146168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939000e-55a0-4c65-a38e-c61f6c2b589f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:58.195475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:58.196400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.196686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.196967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.199333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=f82d09c494574602ae59009847734816, user.id=7e11e220b6b74c059ee7e5ae04874e38) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:58.199685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:58.201170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad858ed4-4227-4304-9687-45475544b9fb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:58.209149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 110/225] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:33:57 2022] GET /identity/v3/role_assignments?user.id=7e11e220b6b74c059ee7e5ae04874e38&scope.project.id=f82d09c494574602ae59009847734816&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:58.210763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c94c-66c5-4be1-bf87-463dcbbf6ad3 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.211305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c94c-66c5-4be1-bf87-463dcbbf6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.211874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c94c-66c5-4be1-bf87-463dcbbf6ad3 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.213415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 111/226] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:58.223895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.223895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.223895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.248379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:58.249864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:58.271312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:58.274722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d908f-c80d-49ca-9c0d-e9bac5dde677 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:58.332894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:58.351019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:58.351785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.352128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.352437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.354132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:58.356129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:58.359040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 116/227] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:58 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:58.367026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:58.389023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 112/228] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:33:58.425966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:58.586164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0df6-44f2-4419-84fc-84562dd8649a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:58.589628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4662f-77e5-46f7-bd47-e25a90d834ce None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:58.649570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:58.650712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:58.651436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.652285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.652568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816/users/07c70a93a202429393c91efa68fab0a3/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.653539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.653826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.654100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.655918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82d09c494574602ae59009847734816, user_id=07c70a93a202429393c91efa68fab0a3, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:58.657373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:58.671473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:33:58.676545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:33:58.677460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:33:58.678259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 113/229] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:33:58.684346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:58.718987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 117/230] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:58 2022] PUT /identity/v3/projects/f82d09c494574602ae59009847734816/users/07c70a93a202429393c91efa68fab0a3/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:58.728491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:58.820528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd72e9e-68ce-450e-8759-5282de2b0c27 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:58.872127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:58.872900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:58.873195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:58.873472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:58.874233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:33:58.874544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:58.875990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:58.885935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 114/231] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:33:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:58.891890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:58.927685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:59.010519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8e12e-dbf3-4777-ba51-846beb173f05 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:59.051671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:59.052351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:59.052640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:59.052921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] PATH_INFO: `/v3/users/07c70a93a202429393c91efa68fab0a3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:59.054175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] RBAC: Authorizing `identity:get_user(user_id=07c70a93a202429393c91efa68fab0a3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:59.055729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:59.057916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 118/232] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:33:58 2022] GET /identity/v3/users/07c70a93a202429393c91efa68fab0a3 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:59.063570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:59.189783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:59.202718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29afa10-ba29-4f11-8520-0870c70afbd1 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:59.247539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bab77-4a6f-4a86-85e1-c92c6f774ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:59.248296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bab77-4a6f-4a86-85e1-c92c6f774ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:59.248597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bab77-4a6f-4a86-85e1-c92c6f774ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:59.248927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bab77-4a6f-4a86-85e1-c92c6f774ea9 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:59.250207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bab77-4a6f-4a86-85e1-c92c6f774ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:59.251744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bab77-4a6f-4a86-85e1-c92c6f774ea9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:59.253604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 115/233] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:33:59 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:33:59.259657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:33:59.363124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:33:59.374272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354faa-10b2-46d1-b6ed-896e6e810828 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:33:59.414695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f781a-e18e-4bb1-b3fb-d5b0d005ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:33:59.415371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f781a-e18e-4bb1-b3fb-d5b0d005ffd4 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:59.415658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f781a-e18e-4bb1-b3fb-d5b0d005ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:59.415968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f781a-e18e-4bb1-b3fb-d5b0d005ffd4 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816/users/07c70a93a202429393c91efa68fab0a3/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:59.418837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f781a-e18e-4bb1-b3fb-d5b0d005ffd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82d09c494574602ae59009847734816, user_id=07c70a93a202429393c91efa68fab0a3, role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:33:59.420328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f781a-e18e-4bb1-b3fb-d5b0d005ffd4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:33:59.531078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 119/234] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:33:59 2022] PUT /identity/v3/projects/f82d09c494574602ae59009847734816/users/07c70a93a202429393c91efa68fab0a3/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:33:59.871620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa32c4-67d2-45f4-bc31-605c608fa78b None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:59.872000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa32c4-67d2-45f4-bc31-605c608fa78b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:59.872218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa32c4-67d2-45f4-bc31-605c608fa78b None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:59.873740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 116/235] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:33:59.879253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f7f0-9848-48d7-95d8-71f1214123e0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:33:59.879546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f7f0-9848-48d7-95d8-71f1214123e0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:33:59.879857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f7f0-9848-48d7-95d8-71f1214123e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:33:59.903496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a379f7f0-9848-48d7-95d8-71f1214123e0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:33:59.904728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a379f7f0-9848-48d7-95d8-71f1214123e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:33:59.988950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 120/236] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:00.002214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a5cb-3972-4786-a6b9-9d38bd25a228 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.002507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a5cb-3972-4786-a6b9-9d38bd25a228 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.002793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a5cb-3972-4786-a6b9-9d38bd25a228 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.004458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 117/237] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:00.009702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.010002 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.010339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.021034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a5cb-3972-4786-a6b9-9d38bd25a228 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:00.060517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:00.061460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:00.200328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 121/238] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:00.224892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:00.242445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a5cb-3972-4786-a6b9-9d38bd25a228 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:00.248122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:00.302323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:00.303222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.303665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.304159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.305663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:00.307257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:00.310218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 118/239] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:00.315666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:00.357280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:00.425993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e8d44-8a5a-4234-9aca-05e7a7e7c59a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:00.474981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022789a-7ea9-41d3-ba95-61ffc3bcbcf5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:00.487715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:00.488391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.488674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.488947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.511394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:00.517846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:00.518695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:00.519451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:00.520938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 122/240] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:00.526032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:00.539314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:00.539960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.540245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.540520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.541221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:00.544354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:00.626417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:00.639395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 119/241] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:00 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:00.664553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50e900-a640-4b89-b4b9-615e9c3b6af0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:00.709835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:00.710523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.710808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.711080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.711827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:00.712133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:00.713509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86946d-9af3-4ce4-85bd-b83f91fec552 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:00.728586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 123/242] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:00.734421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:00.846352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:00.870787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c87147-8515-4d0e-b96d-8bba4444f617 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:00.920101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:00.920770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.921058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.921342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] PATH_INFO: `/v3/users/804c96a696fe471da083ab0aa633002d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.924350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44f0b-3fef-426f-9360-3e6d3566fbbd None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.924643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44f0b-3fef-426f-9360-3e6d3566fbbd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.924923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44f0b-3fef-426f-9360-3e6d3566fbbd None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.927550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 124/243] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:00.931690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:00.932255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:00.932924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:00.938294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] RBAC: Authorizing `identity:get_user(user_id=804c96a696fe471da083ab0aa633002d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:00.943482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:00.943482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 120/244] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:00 2022] GET /identity/v3/users/804c96a696fe471da083ab0aa633002d => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:00.950729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:00.960063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:00.961350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:01.062021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 125/245] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:01.091542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.092201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1905-6958-48d6-b3ee-e1a09d3ab39d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.135364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.136563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.137012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.137304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.153383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:01.204534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:01.218883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:01.220641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:01.247321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16fc3a-82d1-46f3-afaf-8456dc7081b4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.291619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29abe-47e4-41dd-b189-b86defda77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.292902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29abe-47e4-41dd-b189-b86defda77bd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.293219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29abe-47e4-41dd-b189-b86defda77bd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.294016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29abe-47e4-41dd-b189-b86defda77bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.309082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29abe-47e4-41dd-b189-b86defda77bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-09f29abe-47e4-41dd-b189-b86defda77bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:01.315779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:01.316799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:01.319651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 126/246] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:01.320524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3840d-bc67-4c35-a3d7-239e3e02001c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.320772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3840d-bc67-4c35-a3d7-239e3e02001c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.322085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3840d-bc67-4c35-a3d7-239e3e02001c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.322567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 127/247] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:01.328647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.328936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.329213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.355894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 121/248] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:01.356565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.392789 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:01.394007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:01.402977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:01.465487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e002081-dec0-4219-a044-d4d694eb7066 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.512533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 128/249] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:01.513465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.524476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.525231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.525523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.525802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.526876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:01.527193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:01.528601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:01.550179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 122/250] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:01.556320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.576397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:01.622416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012252d-8995-4f37-8e5f-2069ec578e2b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.660561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.662978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.663392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.663847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.665167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:01.666834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:01.669675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 129/251] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:01.670563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.700329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697cb90-6d3b-46a7-80b5-715200cfb096 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.708721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:01.771734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.772428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.772717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.772997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] PATH_INFO: `/v3/users/7e11e220b6b74c059ee7e5ae04874e38` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.780357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a26c3-d78f-4131-81f5-5458c1f798e1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] RBAC: Authorizing `identity:get_user(user_id=7e11e220b6b74c059ee7e5ae04874e38)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:01.782264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:01.784418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 123/252] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/users/7e11e220b6b74c059ee7e5ae04874e38 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:01.785208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.808402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:01.817709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.818363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.818651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.824055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.831127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:01.836455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:01.837591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:01.838566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:01.840291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 130/253] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:01.841713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:01.953533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3160d-ed1e-41f2-9a1a-0ab391137995 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:01.990760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:01.991433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:01.991751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:01.992113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:01.993373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:01.995674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:01.997950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 131/254] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:01.998953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:02.064897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:02.083879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5750-618a-4393-8b30-716509a6fe9b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:02.121971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e971b-8ee6-4a0a-bfb6-8d62d418cfff None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:02.131354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:02.132006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.132288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.132664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.133469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] RBAC: Adding query filter params (role.id=3d5a74c46b9e48b989499e004a8a412b, scope.project.id=f82d09c494574602ae59009847734816, user.id=804c96a696fe471da083ab0aa633002d) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:02.133780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:02.135322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:02.157815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:02.158444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.158728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.159007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.159730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:02.160066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:02.161448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:02.161739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 124/255] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/role_assignments?user.id=804c96a696fe471da083ab0aa633002d&scope.project.id=f82d09c494574602ae59009847734816&role.id=3d5a74c46b9e48b989499e004a8a412b => generated 259 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:02.162577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:02.170720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 132/256] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:02.176455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:02.288516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:02.348802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da8d0-e28b-4e1a-8cca-dee3611bb30f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:02.375288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:02.408910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de79b5-079e-46af-b3a9-b41792339452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:02.409574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de79b5-079e-46af-b3a9-b41792339452 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.409861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de79b5-079e-46af-b3a9-b41792339452 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.410141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de79b5-079e-46af-b3a9-b41792339452 None admin] PATH_INFO: `/v3/users/07c70a93a202429393c91efa68fab0a3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.411359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de79b5-079e-46af-b3a9-b41792339452 None admin] RBAC: Authorizing `identity:get_user(user_id=07c70a93a202429393c91efa68fab0a3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:02.414257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de79b5-079e-46af-b3a9-b41792339452 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:02.415944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 133/257] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:02 2022] GET /identity/v3/users/07c70a93a202429393c91efa68fab0a3 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:02.417670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8645-3cb6-491c-b80d-3b21b9c3634d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.417960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8645-3cb6-491c-b80d-3b21b9c3634d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.418239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8645-3cb6-491c-b80d-3b21b9c3634d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.419738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 134/258] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:02.424867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc8645-3cb6-491c-b80d-3b21b9c3634d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:02.430719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46c942-c19e-4897-82e7-5aea7f433587 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:02.466024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8411f-ece0-4b7e-b0d6-431b4f96abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:02.466715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8411f-ece0-4b7e-b0d6-431b4f96abd7 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.467015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8411f-ece0-4b7e-b0d6-431b4f96abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.467289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8411f-ece0-4b7e-b0d6-431b4f96abd7 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816/users/7e11e220b6b74c059ee7e5ae04874e38/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.469342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8411f-ece0-4b7e-b0d6-431b4f96abd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82d09c494574602ae59009847734816, user_id=7e11e220b6b74c059ee7e5ae04874e38, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:02.470816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8411f-ece0-4b7e-b0d6-431b4f96abd7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:02.538981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc8645-3cb6-491c-b80d-3b21b9c3634d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:02.554642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 125/259] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:02 2022] PUT /identity/v3/projects/f82d09c494574602ae59009847734816/users/7e11e220b6b74c059ee7e5ae04874e38/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:02.555918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.556172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.556456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.580348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:02.581018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:02.581335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:02.581649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:02.598240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:02.599604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:02.688586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:02.736635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:02.738137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:02.746778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 126/260] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:02.784561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:02.828871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:02.941949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 135/261] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:34:02.947055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:02.972602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a8716-fbc6-4463-a2c9-97653d9ae0b5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:03.043505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:03.044190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.044476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.044750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.066253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:03.073910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:03.076035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:03.078023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:03.081295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 127/262] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:03.086659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:03.109597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:03.149189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0487fe-e296-4436-a46f-84276dad5518 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:03.184414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:03.200676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8046c1-5576-4ecf-84cd-244973f4bd26 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:03.237487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:03.238351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.238746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.239114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.240079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:03.240409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:03.243955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:03.250294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:03.251240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.251732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.252262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.253701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:03.255371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:03.257684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 136/263] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:02 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:03.263286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 128/264] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:03.264527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:03.268222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:03.428338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304673c-d096-4e88-ba6e-c0620d48a236 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:03.496607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:03.498148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.498661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.499135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.500166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=f82d09c494574602ae59009847734816, user.id=07c70a93a202429393c91efa68fab0a3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:03.500694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:03.502332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:03.513929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 137/265] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:03 2022] GET /identity/v3/role_assignments?user.id=07c70a93a202429393c91efa68fab0a3&scope.project.id=f82d09c494574602ae59009847734816&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:03.581981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b982-f4d6-45ff-8feb-90cfad0ae2f2 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:03.634285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064ed01-69f3-4760-8149-6d87dfa02818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:03.634941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ed01-69f3-4760-8149-6d87dfa02818 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.635227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ed01-69f3-4760-8149-6d87dfa02818 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.636042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ed01-69f3-4760-8149-6d87dfa02818 None admin] PATH_INFO: `/v3/users/07c70a93a202429393c91efa68fab0a3` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.640495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ed01-69f3-4760-8149-6d87dfa02818 None admin] RBAC: Authorizing `identity:get_user(user_id=07c70a93a202429393c91efa68fab0a3)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:03.641978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ed01-69f3-4760-8149-6d87dfa02818 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:03.643913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 129/266] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:03 2022] GET /identity/v3/users/07c70a93a202429393c91efa68fab0a3 => generated 283 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:03.650081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:03.676436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c06d-68d7-46db-821d-d0f17f7cb6f9 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.676769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c06d-68d7-46db-821d-d0f17f7cb6f9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.677005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c06d-68d7-46db-821d-d0f17f7cb6f9 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.678730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 130/267] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:03.684639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:03.701001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca1ab-d942-4fdd-9f27-0370f73e964f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.701518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca1ab-d942-4fdd-9f27-0370f73e964f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.704603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca1ab-d942-4fdd-9f27-0370f73e964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.740925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1b5ca1ab-d942-4fdd-9f27-0370f73e964f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:03.742146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1b5ca1ab-d942-4fdd-9f27-0370f73e964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:03.772258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:03.829352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99ef00-fd9d-4f92-a551-b10c53faad17 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:03.872531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 131/268] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:03.873649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1dfe-5cd7-4363-9cf3-b4f3ee34bc14 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.873905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1dfe-5cd7-4363-9cf3-b4f3ee34bc14 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.874180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1dfe-5cd7-4363-9cf3-b4f3ee34bc14 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.874790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:03.875422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.875709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.876032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.880574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 132/269] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:03.886143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:03.886476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:03.886762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:03.911723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:03.913184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:03.992093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:03.994351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.015974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 133/270] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:04.016824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.029992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:04.126085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:04.151157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eaf1-19f3-405b-8ec3-130c27523d3e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.164736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 138/271] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:04.165607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.200305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.201205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.201868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.202213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.203789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:04.205551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.211936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 134/272] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:04.212747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.289153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265f973-af49-4db6-bf0d-e3bbb6c5f518 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.309270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:04.325884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff49ee-b768-4259-930a-3fe681937477 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.328359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.329374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.329930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.330401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.343701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:04.349000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:04.349835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:04.350600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:04.352960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 139/273] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:04.358965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.364844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.365502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.365795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.366078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.367277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:04.368751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.376254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 135/274] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:04.376254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.395137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:04.498093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082de2d-b0c2-47af-bc7c-789f2ecb32b1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.507620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ba05-f694-4636-858f-c79f4d345ed8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.546750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.547688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.548641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.549445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:04.550988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.551211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.552107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.552595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.553068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.554018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:04.554531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:04.556128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.566003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 136/275] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:04.567160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.641211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 140/276] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:04 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:04.648875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.650284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:04.677872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a88e8-2cf8-4271-a992-c555f39b325c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.710402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:04.744660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.746126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.746393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.746717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.747621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] RBAC: Adding query filter params (role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=f82d09c494574602ae59009847734816, user.id=07c70a93a202429393c91efa68fab0a3) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:04.748003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:04.749602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ec421-5414-4145-bd4a-3940751b889c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.759827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 137/277] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/role_assignments?user.id=07c70a93a202429393c91efa68fab0a3&scope.project.id=f82d09c494574602ae59009847734816&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:04.793496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8201-16d2-45a7-951c-4fe21ca97574 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.793843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8201-16d2-45a7-951c-4fe21ca97574 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.794135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8201-16d2-45a7-951c-4fe21ca97574 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.796317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 138/278] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:04.804589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.804799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.805088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.817975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9a0e2-9214-4430-b682-50c34ad1ef33 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:04.853361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:04.855447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:04.860920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:04.861896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:04.862516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:04.862961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] PATH_INFO: `/v3/users/ef4488bbbdd14f158d2150c96fef5870` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:04.880897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] RBAC: Authorizing `identity:get_user(user_id=ef4488bbbdd14f158d2150c96fef5870)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:04.882736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:04.885086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 141/279] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/users/ef4488bbbdd14f158d2150c96fef5870 => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:04.892042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:04.972475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 139/280] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:04.997266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:05.010285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:05.024631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b599d-708f-45ec-b4d2-f4f7038cc1ef None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:05.067470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:05.068526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.069044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.069325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.070128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, user.id=ef4488bbbdd14f158d2150c96fef5870, scope.system=all) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:05.070480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:05.072014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:05.078938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 142/281] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/role_assignments?user.id=ef4488bbbdd14f158d2150c96fef5870&scope.system=all&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:05.118146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:05.158635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe88022-5a3a-4cff-8754-a27a9c09e6ab None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:05.199842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89431e-7baa-433a-990d-d77885263cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:05.200539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89431e-7baa-433a-990d-d77885263cef None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.200825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89431e-7baa-433a-990d-d77885263cef None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.201111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89431e-7baa-433a-990d-d77885263cef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.213416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89431e-7baa-433a-990d-d77885263cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-bc89431e-7baa-433a-990d-d77885263cef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:05.219369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:05.220361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:05.221375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 140/282] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:05.226607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:05.348896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643ee0-7e49-48a1-87ec-7bd0ca96cdce None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:05.372650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96d3a5-93bf-4bee-8827-7272a7e883ab None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.372972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96d3a5-93bf-4bee-8827-7272a7e883ab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.373273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96d3a5-93bf-4bee-8827-7272a7e883ab None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.374689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 141/283] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:05.380120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.380665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.381171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.407517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:05.408179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.408463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.408735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.409462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:05.409766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:05.411143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:05.419690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:05.420917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:05.435261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 143/284] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:05.440302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:05.472349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:05.543258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 142/285] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:05.575383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:05.618882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6f76-fa5b-4ecb-9a91-bae25d11485e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:05.668068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:05.717791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c36e8c-9bb1-4f19-af5a-d1d64e795f12 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:05.745668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:05.746338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.746624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.746905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] PATH_INFO: `/v3/users/804c96a696fe471da083ab0aa633002d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.748146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] RBAC: Authorizing `identity:get_user(user_id=804c96a696fe471da083ab0aa633002d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:05.749595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:05.755499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 144/286] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:05 2022] GET /identity/v3/users/804c96a696fe471da083ab0aa633002d => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:05.756682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:05.759894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:05.760955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.761428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.762200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.774352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:05.780671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:05.781560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:05.782352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:05.785081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 143/287] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:05.793696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:05.895482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:05.914273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ba67f-dce0-4769-9b02-173f525566e7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:05.965191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:05.965839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:05.966120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:05.966395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:05.967574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:05.969038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:05.971011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 145/288] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:05 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:05.976958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:06.025985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff52d3-5922-4996-8b98-2525fd60cc39 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:06.065384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:06.103348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12619a1-4551-4229-bcc7-ef95f838aa63 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:06.105355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:06.105981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:06.106264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:06.106539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:06.107261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:06.107565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:06.109032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:06.124658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 144/289] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:06.131563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:06.178567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:06.179165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:06.179445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:06.179719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816/users/804c96a696fe471da083ab0aa633002d/roles/3d5a74c46b9e48b989499e004a8a412b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:06.183458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] RBAC: Authorizing `identity:create_grant(project_id=f82d09c494574602ae59009847734816, user_id=804c96a696fe471da083ab0aa633002d, role_id=3d5a74c46b9e48b989499e004a8a412b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:06.184932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:06.262755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 146/290] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:05 2022] PUT /identity/v3/projects/f82d09c494574602ae59009847734816/users/804c96a696fe471da083ab0aa633002d/roles/3d5a74c46b9e48b989499e004a8a412b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:34:06.268591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e5a62-5217-4d8c-bb71-8292bf2b955b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:06.306537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:06.307723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:06.308340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:06.308818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] PATH_INFO: `/v3/users/7e11e220b6b74c059ee7e5ae04874e38` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:06.310675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] RBAC: Authorizing `identity:get_user(user_id=7e11e220b6b74c059ee7e5ae04874e38)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:06.312159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:06.314157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 145/291] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:06 2022] GET /identity/v3/users/7e11e220b6b74c059ee7e5ae04874e38 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:06.319866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:06.345625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:06.484723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b309b64-60d4-4e17-81b6-bb32cc388d8d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:06.522096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:06.522730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:06.523017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:06.523298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:06.594629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:06.596121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:06.618506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:06.700102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 147/292] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:06.708910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:06.777811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:06.837058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22375a4f-cb70-4297-91ca-23705c236c94 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:06.872646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fac28-9ae7-4ea5-9c17-da7ef8d69da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:06.873300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fac28-9ae7-4ea5-9c17-da7ef8d69da2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:06.873582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fac28-9ae7-4ea5-9c17-da7ef8d69da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:06.873859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fac28-9ae7-4ea5-9c17-da7ef8d69da2 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:06.875035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fac28-9ae7-4ea5-9c17-da7ef8d69da2 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:06.876509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fac28-9ae7-4ea5-9c17-da7ef8d69da2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:06.878476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 146/293] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:06 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:06.884264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:07.004863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a70e57-a637-4dae-b42b-5910624215d7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:07.019597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:07.041609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:07.042429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.042768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.043169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.044005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=f82d09c494574602ae59009847734816, user.id=7e11e220b6b74c059ee7e5ae04874e38) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:07.044325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:07.045792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29bc00-232a-4ffb-8e0b-8fc0b59ee263 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:07.052667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 148/294] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:06 2022] GET /identity/v3/role_assignments?user.id=7e11e220b6b74c059ee7e5ae04874e38&scope.project.id=f82d09c494574602ae59009847734816&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:07.465556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5be92-cbf3-4d92-a5db-31526ee4d195 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.465906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5be92-cbf3-4d92-a5db-31526ee4d195 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.466130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5be92-cbf3-4d92-a5db-31526ee4d195 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.467874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 147/295] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:07.471411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a454f9-4ea4-443a-b1c1-461f3b4a1924 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.471709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a454f9-4ea4-443a-b1c1-461f3b4a1924 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.472023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a454f9-4ea4-443a-b1c1-461f3b4a1924 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.473419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.473702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.473979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.478102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 149/296] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:07.483265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e0a53-ccad-4be9-9620-c1dda126d9aa None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.483557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e0a53-ccad-4be9-9620-c1dda126d9aa None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.483861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e0a53-ccad-4be9-9620-c1dda126d9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.497375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:07.498594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:07.507587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6c8e0a53-ccad-4be9-9620-c1dda126d9aa None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:07.508826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6c8e0a53-ccad-4be9-9620-c1dda126d9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:07.586126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 148/297] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:07.608870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:07.614481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 150/298] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:07.626642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f2c7-404d-457d-8144-491ad99bb8db None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.626937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f2c7-404d-457d-8144-491ad99bb8db None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.627217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f2c7-404d-457d-8144-491ad99bb8db None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.629057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 151/299] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:07.634551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.634844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.636200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.654897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:07.656135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:07.665292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:07.720210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37ab2c-4d2c-4a50-8cd0-6afcdbb2e6e8 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:07.739833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 152/300] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:07.739833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:07.765874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:07.766522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.766807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.767079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.778069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:07.782199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:07.783016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:07.783916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:07.784702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 149/301] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:07.785338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:07.856166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841245-7901-4c17-99a5-2ecd1ad6bd04 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:07.893075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c33d4f-a018-491b-9dbb-0361c4d65236 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:07.895842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:07.896498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.896785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.897066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.898217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:07.899671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:07.901324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 153/302] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:07.902640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:07.906702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:07.934229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:07.934881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:07.935196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:07.935442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:07.946389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:07.951635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:07.952591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:07.953389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 150/303] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:07.954026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:08.022122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468029-9f65-4c3f-be4c-697b5184b751 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.025211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:08.059887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec868d-936b-4aa6-9880-f3563830998b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.060204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.061011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.061768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.063046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.063953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:08.064412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.066275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.078793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 154/304] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:08.079829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:08.094801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.095431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.095718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.096028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] PATH_INFO: `/v3/groups` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.096742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.098182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.175989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 151/305] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Jul 25 22:34:07 2022] POST /identity/v3/groups => generated 229 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:08.188940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:08.192023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcea0f-5347-43b3-8429-7a38187bd0e3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.236775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.237848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.238340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.238866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.239876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:08.240417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.242172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.246767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:08.255011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 155/306] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:08.263842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:08.296352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:08.353049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ea9cf-ea87-48e7-aabe-a0498771be10 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.395219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.395985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.396275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.396554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] PATH_INFO: `/v3/users/ef4488bbbdd14f158d2150c96fef5870` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.397730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c4450-758a-4967-8e19-ca535e06d562 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.397833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4488bbbdd14f158d2150c96fef5870)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.399183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.401966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 152/307] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:08 2022] GET /identity/v3/users/ef4488bbbdd14f158d2150c96fef5870 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:08.407484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:08.443094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.444245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.444535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.444862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] PATH_INFO: `/v3/users/419bcf8114c84997bba3a37b7b04ba5d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.463083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] RBAC: Authorizing `identity:get_user(user_id=419bcf8114c84997bba3a37b7b04ba5d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.466264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.469553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 156/308] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:08 2022] GET /identity/v3/users/419bcf8114c84997bba3a37b7b04ba5d => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:08.474766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:08.523145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:08.530888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af642-61c9-4f1b-9de2-7cc27e1b73d3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.569478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f41f9-febc-4bc4-be2c-33406909dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.570514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f41f9-febc-4bc4-be2c-33406909dd6b None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.571004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f41f9-febc-4bc4-be2c-33406909dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.571509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f41f9-febc-4bc4-be2c-33406909dd6b None admin] PATH_INFO: `/v3/system/users/ef4488bbbdd14f158d2150c96fef5870/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.573311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f41f9-febc-4bc4-be2c-33406909dd6b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef4488bbbdd14f158d2150c96fef5870, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.574905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f41f9-febc-4bc4-be2c-33406909dd6b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.590143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:08.605837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07044a37-9783-43eb-a3c5-43af664fc381 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:08.641334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:08.642030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.642307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.642639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.643456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] RBAC: Adding query filter params (role.id=3d5a74c46b9e48b989499e004a8a412b, user.id=419bcf8114c84997bba3a37b7b04ba5d, scope.system=all) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:08.643795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:08.645231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e50e16-c0a7-4fd7-af56-ef48dd7e28e8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:08.650184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 153/309] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Jul 25 22:34:08 2022] PUT /identity/v3/system/users/ef4488bbbdd14f158d2150c96fef5870/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:34:08.659808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 157/310] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 25 22:34:08 2022] GET /identity/v3/role_assignments?user.id=419bcf8114c84997bba3a37b7b04ba5d&scope.system=all&role.id=3d5a74c46b9e48b989499e004a8a412b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:08.749208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f900-eb54-47bd-ad67-f0942fe30fd4 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.750242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f900-eb54-47bd-ad67-f0942fe30fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.750745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f900-eb54-47bd-ad67-f0942fe30fd4 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.752969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 154/311] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:08.758478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:08.758796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:08.759030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:08.780442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:08.781730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:08.865120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 158/312] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:08.888838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f900-eb54-47bd-ad67-f0942fe30fd4 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:09.004422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f900-eb54-47bd-ad67-f0942fe30fd4 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:09.042211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:09.043007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:09.043297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:09.043579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:09.055167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:09.061420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:09.062317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:09.063133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 155/313] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:09.068546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:09.151502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:09.171379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c747e5-5248-4c43-ae87-a8490d67b3ae None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:09.207671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:09.208334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:09.208614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:09.208883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:09.209599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:09.209902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:09.211268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:09.220133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 159/314] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:09.225653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:09.249118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:09.347439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc558b-a910-44d1-9cb3-ff45c1e0fa18 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:09.382463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:09.383122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:09.383410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:09.383692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] PATH_INFO: `/v3/users/804c96a696fe471da083ab0aa633002d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:09.384920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] RBAC: Authorizing `identity:get_user(user_id=804c96a696fe471da083ab0aa633002d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:09.386930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:09.388957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 156/315] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:09 2022] GET /identity/v3/users/804c96a696fe471da083ab0aa633002d => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:09.394269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:09.505164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996fa23-a8a3-401a-8360-54cff81f4b62 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:09.540756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:09.541407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:09.541701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:09.541971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:09.554449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:09.613300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:09.614788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:09.720539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 160/316] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:09.726293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:09.817782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:09.833660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dcb5e-12ab-441f-be8b-357fb0aa9677 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:09.872294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df8192-3b9a-48e8-beae-57714665accf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:09.872947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df8192-3b9a-48e8-beae-57714665accf None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:09.873233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df8192-3b9a-48e8-beae-57714665accf None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:09.873508 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df8192-3b9a-48e8-beae-57714665accf None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:09.874715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df8192-3b9a-48e8-beae-57714665accf None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:09.876218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df8192-3b9a-48e8-beae-57714665accf None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:09.878247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 157/317] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:09 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:09.884006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:09.931629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:09.992389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fb99-02d8-43c8-a310-eeb4dfe6a8b9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:10.028618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:10.029260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.029545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.029842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.030659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] RBAC: Adding query filter params (role.id=3d5a74c46b9e48b989499e004a8a412b, scope.project.id=f82d09c494574602ae59009847734816, user.id=804c96a696fe471da083ab0aa633002d) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:10.030990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:10.032613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123caa-565b-4248-aea0-34b49dab7274 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:10.039583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 161/318] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:09 2022] GET /identity/v3/role_assignments?user.id=804c96a696fe471da083ab0aa633002d&scope.project.id=f82d09c494574602ae59009847734816&role.id=3d5a74c46b9e48b989499e004a8a412b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:10.441631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc2919-1e09-4efb-b286-7ada7f8ba79d None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.441992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc2919-1e09-4efb-b286-7ada7f8ba79d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.442186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc2919-1e09-4efb-b286-7ada7f8ba79d None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.443599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 158/319] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:10.449137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.449588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.449752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.468673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:10.469901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:10.543788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 162/320] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:10.563219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc2919-1e09-4efb-b286-7ada7f8ba79d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:10.669016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc2919-1e09-4efb-b286-7ada7f8ba79d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:10.704431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558837-dd57-46ca-8e7d-e28fe3d556c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:10.705080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558837-dd57-46ca-8e7d-e28fe3d556c6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.705366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558837-dd57-46ca-8e7d-e28fe3d556c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.705642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558837-dd57-46ca-8e7d-e28fe3d556c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.706771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558837-dd57-46ca-8e7d-e28fe3d556c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:10.708238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558837-dd57-46ca-8e7d-e28fe3d556c6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:10.710056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 159/321] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:10.715589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:10.751960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:10.776197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068ac66-dfac-45ad-ae6b-a66c161d26b3 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.776501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068ac66-dfac-45ad-ae6b-a66c161d26b3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.776761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068ac66-dfac-45ad-ae6b-a66c161d26b3 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.778258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 160/322] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:10.783032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28965-32f2-47e2-9481-18a79d3c7161 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.783327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28965-32f2-47e2-9481-18a79d3c7161 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.783612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28965-32f2-47e2-9481-18a79d3c7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.801891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-dec28965-32f2-47e2-9481-18a79d3c7161 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:10.803100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-dec28965-32f2-47e2-9481-18a79d3c7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:10.819787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cb1de-eed2-4fd7-b84b-3f21813a2900 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:10.820900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:10.855658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:10.856327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.856636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.856913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] PATH_INFO: `/v3/groups` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.857628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:10.859097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:10.873824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 161/323] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:10.875236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09574407-7826-40c3-b6fe-00f842ca86d9 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.875509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09574407-7826-40c3-b6fe-00f842ca86d9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.878191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09574407-7826-40c3-b6fe-00f842ca86d9 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.878191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 162/324] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:10.882205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:10.882509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:10.882759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:10.900172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:10.901496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:10.963306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 163/325] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Jul 25 22:34:10 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:10.964263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:10.967198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 163/326] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:10.991128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.086554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:11.087389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:11.095105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e711-2b51-43f3-9287-c0147e7a347c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.110930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71087309-87e0-4d30-a25c-7837afccb921 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.134485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.136183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.136468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.136749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.151514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:11.155600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.156232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.156520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.156797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:11.156968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:11.157777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:11.158538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 164/327] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:11.164282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.176453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:11.182278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:11.183877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:11.184895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 164/328] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:11.188882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.300794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fa868-f6bb-42eb-909a-7bc57789f38f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.321170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b64518-e41b-4506-8856-3632ffeaf4ef None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.346463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.347021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.347307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.347586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.348438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:11.348706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:11.350105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:11.361349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 165/329] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:11.361514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.362088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.362372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.362647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.363376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:11.363677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:11.365083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:11.366899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.374851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 165/330] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:11.380916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.384970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:11.395499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:11.501858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3073a-7e36-451a-bc58-1f29c78ea5ff None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.513176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936282-e2f4-4baa-9856-443ffd179ab7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.546480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.547135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.547418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.548048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] PATH_INFO: `/v3/users/ef4488bbbdd14f158d2150c96fef5870` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.549523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4488bbbdd14f158d2150c96fef5870)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:11.551452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:11.553735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 166/331] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:11 2022] GET /identity/v3/users/ef4488bbbdd14f158d2150c96fef5870 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:11.559814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.561584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.562639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.563133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.563682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] PATH_INFO: `/v3/users/419bcf8114c84997bba3a37b7b04ba5d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.565050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] RBAC: Authorizing `identity:get_user(user_id=419bcf8114c84997bba3a37b7b04ba5d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:11.566538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:11.568534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 166/332] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:11 2022] GET /identity/v3/users/419bcf8114c84997bba3a37b7b04ba5d => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:11.575308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:11.660419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:11.666787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:11.685836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f84c7-0f6b-47ba-9872-81de16c3b746 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.700584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fe7b0-24bb-4248-8e58-a8c45663c17d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:11.732979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.733610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.733894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.734170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.734975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] RBAC: Adding query filter params (role.id=2f3be5e1b4134b18b93f08ffd7566aa9, user.id=ef4488bbbdd14f158d2150c96fef5870, scope.system=all) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:11.735284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:11.737369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2325d-23ad-409e-9f09-148b693cf1e3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:11.753777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 167/333] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 25 22:34:11 2022] GET /identity/v3/role_assignments?user.id=ef4488bbbdd14f158d2150c96fef5870&scope.system=all&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:11.762381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33158b72-bd0d-4e99-8235-59c5efaf8ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:11.763169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33158b72-bd0d-4e99-8235-59c5efaf8ceb None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:11.763529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33158b72-bd0d-4e99-8235-59c5efaf8ceb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:11.764046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33158b72-bd0d-4e99-8235-59c5efaf8ceb None admin] PATH_INFO: `/v3/system/users/419bcf8114c84997bba3a37b7b04ba5d/roles/3d5a74c46b9e48b989499e004a8a412b` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:11.767882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33158b72-bd0d-4e99-8235-59c5efaf8ceb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=419bcf8114c84997bba3a37b7b04ba5d, role_id=3d5a74c46b9e48b989499e004a8a412b)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:11.769430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33158b72-bd0d-4e99-8235-59c5efaf8ceb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:11.828271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 167/334] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Jul 25 22:34:11 2022] PUT /identity/v3/system/users/419bcf8114c84997bba3a37b7b04ba5d/roles/3d5a74c46b9e48b989499e004a8a412b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:13.488025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466e5b-04e8-4678-aa9f-d49b2deff88a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:13.488925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466e5b-04e8-4678-aa9f-d49b2deff88a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:13.489387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466e5b-04e8-4678-aa9f-d49b2deff88a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:13.490967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 168/335] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:13.497729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:13.498175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:13.498362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:13.505379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa638-cff7-45e3-b609-846b6a73913a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:13.505934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa638-cff7-45e3-b609-846b6a73913a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:13.506446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa638-cff7-45e3-b609-846b6a73913a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:13.508514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 169/336] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:13.523562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:13.524184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:13.524694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:13.526702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:13.527941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:13.565646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:13.566787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:13.647657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 168/337] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:13.679486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:13.726252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 170/338] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:13.753179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:13.770775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:13.792802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684c14-b831-4193-82f6-f162babf2d8f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:13.830995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:13.831568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:13.831882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:13.832160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:13.844178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:13.850311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:13.851224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:13.852047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:13.856733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 169/339] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:13.858506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:13.957089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:13.969123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2115-c9d2-4d5f-848f-1885d103149f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:13.998563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:14.001144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09653c1f-6329-4478-bfb7-9beb11500b2c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:14.009429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:14.010886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.013312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.013312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.013312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:14.013312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:14.014610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:14.025279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 170/340] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:14.031787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:14.065227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:14.065900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.066191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.066476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.094282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:14.099219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:14.100303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:14.101270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:14.108918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 171/341] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:14.116657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:14.165536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7482b6-fc0a-42c2-8a9d-25e9abdf440b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:14.239075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88576c-4ea0-4fe6-8291-3784c7eabceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:14.239719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88576c-4ea0-4fe6-8291-3784c7eabceb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.240032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88576c-4ea0-4fe6-8291-3784c7eabceb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.240460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88576c-4ea0-4fe6-8291-3784c7eabceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.299842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafa751-2a89-419e-9567-f0f2e6955c85 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:14.347571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:14.348555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.348838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.349114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.349836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:14.350141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:14.352123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:14.353718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:14.359370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:14.365174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 172/342] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:14.370622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:14.380124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88576c-4ea0-4fe6-8291-3784c7eabceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:14.385598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88576c-4ea0-4fe6-8291-3784c7eabceb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:14.492494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 171/343] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:34:14.494041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096f131-1e21-4d11-87ca-84febed00606 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.495194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096f131-1e21-4d11-87ca-84febed00606 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.495670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096f131-1e21-4d11-87ca-84febed00606 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.501246 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 172/344] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:14.503158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096f131-1e21-4d11-87ca-84febed00606 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:14.571846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf210a-b2d1-40e9-b0c4-01ee05a947c0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:14.637845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:14.639555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.639555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.639555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.651648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:14.681456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096f131-1e21-4d11-87ca-84febed00606 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:14.740986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e86c3-be3b-4542-bc0b-4c9fa60e3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:14.741996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e86c3-be3b-4542-bc0b-4c9fa60e3944 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.742478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e86c3-be3b-4542-bc0b-4c9fa60e3944 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.742975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e86c3-be3b-4542-bc0b-4c9fa60e3944 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.744537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e86c3-be3b-4542-bc0b-4c9fa60e3944 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:14.746257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e86c3-be3b-4542-bc0b-4c9fa60e3944 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:14.748654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 173/345] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:14 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:14.750349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:14.750858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:14.751325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:14.777649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:14.783354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:14.799527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:14.802096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:14.802594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:14.927960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 174/346] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:14.928741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:14.935161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 173/347] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:14.940688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.084011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.102217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb9601-4d64-4be4-98ee-409a247365aa None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.136888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.140567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.141230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.141514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.141807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.146069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b244-6079-4f9a-940e-ba6bb82d702d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.148552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:15.150056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:15.152693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 175/348] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:14 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:15.153569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.205776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.206900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.207374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.207909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.209302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:15.211031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:15.214100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 174/349] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:14 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:15.219781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.261728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc539f60-b766-43be-a113-e1ea57301b0f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.299236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.299934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.300273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.300554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.311911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:15.317402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:15.318303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:15.319133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 176/350] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:15.319813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.341701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.423378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19830d-9d44-4798-8fba-e1ebac8221e0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.436635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db95cf5-0b7e-474d-a908-ac7ca6b0c4a6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.463578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.464780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.465386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.465912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.466980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:15.467577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:15.469351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:15.473104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0317e-00ff-41df-9673-44b7d6b6ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.473762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0317e-00ff-41df-9673-44b7d6b6ffae None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.474044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0317e-00ff-41df-9673-44b7d6b6ffae None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.474319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0317e-00ff-41df-9673-44b7d6b6ffae None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.475481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0317e-00ff-41df-9673-44b7d6b6ffae None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:15.476819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 175/351] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:15.476978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0317e-00ff-41df-9673-44b7d6b6ffae None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:15.477975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.478927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 177/352] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:15.480163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ce18-2b2f-4a52-8d0e-1451b25dcd3a None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.480449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ce18-2b2f-4a52-8d0e-1451b25dcd3a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.480724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28ce18-2b2f-4a52-8d0e-1451b25dcd3a None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.482258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 178/353] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:15.486897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2316f-2803-4b15-8f7b-1c4ce3a18533 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.486897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2316f-2803-4b15-8f7b-1c4ce3a18533 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.486897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2316f-2803-4b15-8f7b-1c4ce3a18533 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.486897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 179/354] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:15.488193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a28897-4834-47f4-943d-77fc4dfa4d11 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.488479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a28897-4834-47f4-943d-77fc4dfa4d11 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.488753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a28897-4834-47f4-943d-77fc4dfa4d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.508497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-58a28897-4834-47f4-943d-77fc4dfa4d11 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:15.509718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-58a28897-4834-47f4-943d-77fc4dfa4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:15.520078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.591816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 180/355] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:15.591816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.591816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.591816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.609492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:15.610792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:15.613167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.638368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a76bb-4747-4392-9079-f77f2b16a10a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.697854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 181/356] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:15.698871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.700562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.701192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.701473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.701747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.702476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:15.702904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:15.704364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:15.715672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 176/357] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:15.720636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.836017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71ea1-e351-486a-aa44-d361bf435c76 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.837429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.845522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae90c3-9c34-4213-941b-2de4ee170678 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:15.884567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.885771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.886088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.886363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:15.886507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.887012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:15.887224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:15.887324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:15.887540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:15.887638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:15.891400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:15.903576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 182/358] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:15.906023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:15.908967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:15.915307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:15.919554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:15.927663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 177/359] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:15.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.102641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1704-0c67-4d2c-bb5d-773a8a30bf12 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.123849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2baf1-e57a-4de1-b0aa-cffcdac67d36 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.149943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.150676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.151011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.151515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.166933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.167611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.167895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.168132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.168251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:16.174747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:16.175647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:16.176457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 178/360] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:16.177113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.193140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:16.263917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:16.266373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:16.270319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:16.329640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2e5d2-2045-4ff4-83ac-cbfeacd7b451 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.378661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.379210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.379499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.379825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.380568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:16.380878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:16.382281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a1add-e917-4d66-963b-779b1db34451 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:16.391958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 179/361] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:16.393436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970755a2-e677-4082-9175-320460aaa48f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.393736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970755a2-e677-4082-9175-320460aaa48f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.394018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970755a2-e677-4082-9175-320460aaa48f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.400867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 180/362] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:16.401698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970755a2-e677-4082-9175-320460aaa48f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.409898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 183/363] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:16.410741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.489736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:16.523821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4402-0db2-4b5d-b469-826a1ae6b56c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.524344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:16.528902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970755a2-e677-4082-9175-320460aaa48f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.571291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.572082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.572344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.573078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.573359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.573613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.574022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.574119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:16.574891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.574988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:16.575867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:16.587220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 181/364] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:16.592476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.663555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:16.665624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:16.716173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee433a-f8dc-4ddf-83ff-79dd4a90e72a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.762035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a757cc-80d1-4114-a6c9-35d31241cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.762697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a757cc-80d1-4114-a6c9-35d31241cac9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.762984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a757cc-80d1-4114-a6c9-35d31241cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.763269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a757cc-80d1-4114-a6c9-35d31241cac9 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.764493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a757cc-80d1-4114-a6c9-35d31241cac9 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:16.765960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a757cc-80d1-4114-a6c9-35d31241cac9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:16.772285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 182/365] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:16.773281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.773577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.773863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.781865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:16.795170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:16.796851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:16.810799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 184/366] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:16.812593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.816522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:16.887343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 183/367] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:16.888248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:16.942663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be2431-ef07-4432-8f20-0f7989fc6095 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:16.980927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:16.981807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:16.982248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:16.982764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] PATH_INFO: `/v3/users/419bcf8114c84997bba3a37b7b04ba5d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:16.984206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] RBAC: Authorizing `identity:get_user(user_id=419bcf8114c84997bba3a37b7b04ba5d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:16.985781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:16.992093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 185/368] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/users/419bcf8114c84997bba3a37b7b04ba5d => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:16.993200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.020713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce73424-bd15-4b4a-a158-08cdb97b49ed None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.054244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:17.059715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.060258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.060545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.060833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.062146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:17.063846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:17.065957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 184/369] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:17.066881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.076245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:17.107484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a049b-1d4c-479d-afc0-1cc7639b61bc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.144300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.145184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.145639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.146057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.147378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:17.148995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:17.151411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 186/370] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:16 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:17.152423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.192358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ec500-9d34-4da3-9fb8-d1c36e190935 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.293574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.293574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.293574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.293574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:17.294062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:17.294798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:17.296260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 185/371] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:17.297098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.297175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8854c7e-f91f-4b08-b744-173815b47c8a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.310703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.311677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.313365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.313845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.314858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] RBAC: Adding query filter params (role.id=3d5a74c46b9e48b989499e004a8a412b, user.id=419bcf8114c84997bba3a37b7b04ba5d, scope.system=all) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:17.315372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:17.317056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:17.324428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:17.332530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 187/372] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/role_assignments?user.id=419bcf8114c84997bba3a37b7b04ba5d&scope.system=all&role.id=3d5a74c46b9e48b989499e004a8a412b => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:17.339980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.367914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:17.402597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be1fde-382b-4791-b9a2-0889f9babf0f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.441547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.442372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.445713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.445713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.445713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=f82d09c494574602ae59009847734816) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:17.445713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:17.446274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:17.453642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 186/373] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=f82d09c494574602ae59009847734816&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:17.454637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.596040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e287-ad2c-49fb-83fe-2c807eb9d0fb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.607947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac77a5-0c79-4773-b4c6-9dea6aba559a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.639388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:17.652421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.652768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.652991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.653281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.654048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:17.654365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:17.655827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:17.681668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 187/374] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:17.687685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.723501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.724579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.725387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.726619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:17.728378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:17.732093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:17.734278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 188/375] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:17.741901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:17.874936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:17.906115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71f1fc-d066-4462-abe8-3fe4dff92a9a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.935984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84472-2606-4db6-ab9c-c775fde849eb None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:17.983011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:17.983656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:17.983973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:17.984254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.029843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:18.030482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.030768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.031041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.031873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=f82d09c494574602ae59009847734816) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:18.032183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:18.033653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6d13e-2aa5-43b4-9d32-4690ab09124a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:18.049737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 189/376] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=f82d09c494574602ae59009847734816&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 260 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:18.056335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:18.076185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:18.078018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:18.094192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d968-e5c5-4bf9-9ded-84928a50a247 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.094482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d968-e5c5-4bf9-9ded-84928a50a247 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.094779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d968-e5c5-4bf9-9ded-84928a50a247 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.096549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 190/377] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:18.107851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.107851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.108166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.142918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:18.144089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:18.258740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 188/378] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:18.264635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 191/379] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:18.267778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:18.288893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:18.389611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:18.403857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311700-7544-4383-b56a-4725baacff70 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:18.442391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:18.443607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:18.444856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.445340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.445909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] PATH_INFO: `/v3/projects/1511155764c640988e6e51d316abf862` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.448098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] RBAC: Authorizing `identity:get_project(project_id=1511155764c640988e6e51d316abf862)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:18.451674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:18.452452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 189/380] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/projects/1511155764c640988e6e51d316abf862 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:18.458140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:18.514713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9d951-71ec-41f4-adc8-e51846d5e73c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:18.551870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8b302-bedb-4b26-8c8b-da29acae8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:18.552537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b302-bedb-4b26-8c8b-da29acae8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.552822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b302-bedb-4b26-8c8b-da29acae8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.553098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8b302-bedb-4b26-8c8b-da29acae8ef9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.569121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8b302-bedb-4b26-8c8b-da29acae8ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-22e8b302-bedb-4b26-8c8b-da29acae8ef9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:18.574944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:18.575875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:18.576681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:18.577287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 192/381] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:18.579535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aca07-40aa-42fe-824f-7ea58cc90611 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.583833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aca07-40aa-42fe-824f-7ea58cc90611 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.583833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aca07-40aa-42fe-824f-7ea58cc90611 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.585474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 193/382] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:18.587035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.587473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.587731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.598667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0f76-f179-479f-bf43-5d3fa0e604e6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:18.608345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:18.609548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:18.643639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:18.645151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.645746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.646221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] PATH_INFO: `/v3/groups/5e11243d8f5f4c6883ba2a63602d8256` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.654316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] RBAC: Authorizing `identity:get_group(group_id=5e11243d8f5f4c6883ba2a63602d8256)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:18.656088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:18.658803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 190/383] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/groups/5e11243d8f5f4c6883ba2a63602d8256 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:18.659826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:18.692478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:18.695850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 194/384] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:18.698302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:18.769542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:18.814735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959e83-8a3f-4de3-bbf6-ef20ae850288 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:18.850814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e09dfc-11bd-4111-b09d-3180db4c2c6e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:18.858846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:18.859475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.859775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.860063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.860790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] RBAC: Adding query filter params (name=member) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:18.861173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:18.862567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:18.872946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 191/385] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:18.873900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:18.895743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:18.896402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:18.896693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:18.897534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:18.898502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] RBAC: Adding query filter params (group.id=5e11243d8f5f4c6883ba2a63602d8256, role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=1511155764c640988e6e51d316abf862) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:18.898952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:18.901311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:18.910351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 195/386] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/role_assignments?group.id=5e11243d8f5f4c6883ba2a63602d8256&scope.project.id=1511155764c640988e6e51d316abf862&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:18.911240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:19.021251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:19.065300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d7c9-5311-475f-b754-34818c1e29de None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.116165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55ad9a-7700-48c7-b441-39ca98a08767 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.131652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.132352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.132641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.132921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.133864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:19.152263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:19.157567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:19.157795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:19.158700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:19.159492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:19.160237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.160237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.160237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.160588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 192/387] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:19.165378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:19.167068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:19.168831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:19.170224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 196/388] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:18 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:19.181043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:19.339226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01507d-a5f4-49ae-a2d6-c35c4b5b2831 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.371668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68aa57-c2e1-46e5-ae23-1adb0d9d0967 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.383571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.384241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.384557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.385377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.386439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:19.386755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:19.388183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:19.401783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 193/389] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:19.404321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:19.407555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:19.429352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.429946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.430635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.430921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.432740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:19.434365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:19.437764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 197/390] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:19 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:19.444919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:19.512358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:19.581270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e6b2-de0f-4551-b686-5e2ef7b4544a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.614542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375c326-ce54-4df6-99c8-9f6b214109de None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.653566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.654597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.655088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.655569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.657670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:19.659321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:19.663886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 194/391] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:19 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:19.668834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:19.680561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.681180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.682040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.682323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/groups/8545c6d040ac43df935dce91a20e064c/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.689132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8c574b54d4a55bf9d20699942aa77, group_id=8545c6d040ac43df935dce91a20e064c, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:19.690619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:19.755283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:19.783301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 198/392] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 25 22:34:19 2022] PUT /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/groups/8545c6d040ac43df935dce91a20e064c/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:34:19.800698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542047e7-f75f-4922-800e-7907bd6ad9e0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:19.847087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797de3f-faf3-478e-9eae-b8e65d1bdcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:19.848139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797de3f-faf3-478e-9eae-b8e65d1bdcc6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:19.848657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797de3f-faf3-478e-9eae-b8e65d1bdcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:19.849150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797de3f-faf3-478e-9eae-b8e65d1bdcc6 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:19.850807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797de3f-faf3-478e-9eae-b8e65d1bdcc6 None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:19.852651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797de3f-faf3-478e-9eae-b8e65d1bdcc6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:19.855665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 195/393] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:19 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:19.862034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:20.002883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83108f9-891f-486a-b1c9-1ca53d417349 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:20.017415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:20.049016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d93d3c-fd68-4d48-88ab-5e41744655e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:20.050257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d93d3c-fd68-4d48-88ab-5e41744655e3 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.051233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d93d3c-fd68-4d48-88ab-5e41744655e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.051483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d93d3c-fd68-4d48-88ab-5e41744655e3 None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/groups/8545c6d040ac43df935dce91a20e064c/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.053878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d93d3c-fd68-4d48-88ab-5e41744655e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8c574b54d4a55bf9d20699942aa77, group_id=8545c6d040ac43df935dce91a20e064c, role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:20.055449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d93d3c-fd68-4d48-88ab-5e41744655e3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:20.170686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 199/394] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 25 22:34:19 2022] PUT /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77/groups/8545c6d040ac43df935dce91a20e064c/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:20.186486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eac71-b43c-4e8e-ba9c-069a530b537a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.187594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eac71-b43c-4e8e-ba9c-069a530b537a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.188160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eac71-b43c-4e8e-ba9c-069a530b537a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.190066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 196/395] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:20.197939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.202088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.202088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.221266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:20.222503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:20.318638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 200/396] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:20.349482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eac71-b43c-4e8e-ba9c-069a530b537a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:20.492893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eac71-b43c-4e8e-ba9c-069a530b537a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:20.543667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5a585-4ca2-40c0-821b-4e3770f7c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:20.544662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5a585-4ca2-40c0-821b-4e3770f7c389 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.545170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5a585-4ca2-40c0-821b-4e3770f7c389 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.545839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5a585-4ca2-40c0-821b-4e3770f7c389 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.556852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:20.563517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5a585-4ca2-40c0-821b-4e3770f7c389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f2e5a585-4ca2-40c0-821b-4e3770f7c389 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:20.568811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:20.584431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:20.585272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 197/397] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:20.585947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:20.702034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:20.707118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9495b-12f2-4953-b58e-c54e96873623 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:20.752640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfb56e-7c73-4cc3-8a5f-116746854078 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.752987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfb56e-7c73-4cc3-8a5f-116746854078 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.753210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfb56e-7c73-4cc3-8a5f-116746854078 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.754691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 198/398] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:20.756091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:20.756731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.757020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.757299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.758125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:20.758334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:20.760465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:20.762042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:20.762333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:20.762613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:20.770915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 201/399] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:20.776048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:20.797038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:20.798316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:20.937331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 199/400] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:20.959898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098c5cd-dc16-4de2-bb49-505be87c62b2 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:20.977555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.024202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.024861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.025674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.025956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.027229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:21.031632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:21.035053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 202/401] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:20 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:21.048521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.089694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:21.143793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c15798-2b2e-4c31-bbcd-cc95c44b7a77 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.169524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d157-90ff-4291-a105-9eb65e52dd19 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.187602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:21.206150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.206807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.207094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.209688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.209804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.209804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.209804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.209804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.211214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:21.213455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:21.215791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 203/402] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:21 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:21.219024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:21.224160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:21.225116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:21.225884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 200/403] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:21.231126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.231248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.367491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:21.375095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53011b93-9664-4af5-ac1f-94fb39fc3c4b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.388946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be5b80-70d5-4f52-bb64-b3552fadc51c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.423151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30edc43-60ef-4568-aced-4405e7533d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.424182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30edc43-60ef-4568-aced-4405e7533d96 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.424500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30edc43-60ef-4568-aced-4405e7533d96 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.424804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30edc43-60ef-4568-aced-4405e7533d96 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816/groups/8545c6d040ac43df935dce91a20e064c/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.427819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30edc43-60ef-4568-aced-4405e7533d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82d09c494574602ae59009847734816, group_id=8545c6d040ac43df935dce91a20e064c, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:21.429313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30edc43-60ef-4568-aced-4405e7533d96 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:21.431929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.432917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.433527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.434284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.435272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:21.435649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:21.437131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5af016-1142-42fa-8929-6f00312f3237 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:21.446490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 201/404] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:21.448312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2585e1-a940-41bb-a327-2d99c092436d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.448714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2585e1-a940-41bb-a327-2d99c092436d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.449062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2585e1-a940-41bb-a327-2d99c092436d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.450552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 202/405] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:21.455178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2585e1-a940-41bb-a327-2d99c092436d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.504238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 204/406] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 25 22:34:21 2022] PUT /identity/v3/projects/f82d09c494574602ae59009847734816/groups/8545c6d040ac43df935dce91a20e064c/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:21.506151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.506680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.507168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.531030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:21.533648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:21.534572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:21.628120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 205/407] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:21.662188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.664459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2585e1-a940-41bb-a327-2d99c092436d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.734827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.735427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.735958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.736156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.737267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:21.738822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:21.740971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 203/408] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:21 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:21.749047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.769081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:21.787249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eba3f2-9f97-4728-b5fc-23f6bd39f28b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.829351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.830007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.830289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.830558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.843860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:21.849188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:21.850261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:21.851269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:21.852081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 206/409] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:21.857797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:21.914312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93acd0-4e0c-454b-b60b-489bfbadaf81 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:21.955998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:21.993651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:21.995192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:21.996440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:21.997037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:21.999750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:22.002415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:22.008034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 204/410] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:21 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:22.013928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.051135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2aa4-cdba-4caa-8d78-4708e140653a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.098132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:22.098808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.099116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.099414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.100175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:22.100491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:22.106615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:22.127365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 207/411] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:22.132594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.155049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:22.171453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157992b0-8834-43cb-a526-075bd1802a41 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.225754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:22.226608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.226997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.227374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816/groups/8545c6d040ac43df935dce91a20e064c/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.232321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82d09c494574602ae59009847734816, group_id=8545c6d040ac43df935dce91a20e064c, role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:22.233889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:22.297471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af6ef5-2d8d-43fc-9d1e-d9fa4faf38f7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.317770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 205/412] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 25 22:34:22 2022] PUT /identity/v3/projects/f82d09c494574602ae59009847734816/groups/8545c6d040ac43df935dce91a20e064c/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:22.347602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2c360-7804-4932-9ffe-2d9d47d50e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:22.348482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2c360-7804-4932-9ffe-2d9d47d50e47 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.348770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2c360-7804-4932-9ffe-2d9d47d50e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.349048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2c360-7804-4932-9ffe-2d9d47d50e47 None admin] PATH_INFO: `/v3/groups/5e11243d8f5f4c6883ba2a63602d8256` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.356784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2c360-7804-4932-9ffe-2d9d47d50e47 None admin] RBAC: Authorizing `identity:get_group(group_id=5e11243d8f5f4c6883ba2a63602d8256)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:22.358282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2c360-7804-4932-9ffe-2d9d47d50e47 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:22.360418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 208/413] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:22 2022] GET /identity/v3/groups/5e11243d8f5f4c6883ba2a63602d8256 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:22.365807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.383613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7338-d019-498b-9864-790844c2d029 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.383960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7338-d019-498b-9864-790844c2d029 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.384199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7338-d019-498b-9864-790844c2d029 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.386689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 209/414] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:22.392621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.392953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.393180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.428468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:22.429716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:22.468725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:22.547936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 210/415] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:22.551319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a1f81-0f27-4230-9d94-413708916c83 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.577526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.588024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:22.591219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:22.591219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.591219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.591219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] PATH_INFO: `/v3/projects/1511155764c640988e6e51d316abf862` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.591803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] RBAC: Authorizing `identity:get_project(project_id=1511155764c640988e6e51d316abf862)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:22.593234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:22.595135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 206/416] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:22 2022] GET /identity/v3/projects/1511155764c640988e6e51d316abf862 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:22.604354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.694442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dd4bb-2e2d-4864-abf5-9360b04d2ca5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.732965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:22.733616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.734194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.734472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.746681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:22.752406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:22.753298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:22.754066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:22.754659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 211/417] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:22.762670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.862312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:22.881756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd395d-23ba-4903-b5d5-0c93a535d3a7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.923533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:22.924738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:22.926876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69948bd-c70a-4bca-8f82-28f94f8d499f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:22.927377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:22.927932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:22.928896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:22.930832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:22.933079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:22.951675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 212/418] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:22.957331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:22.962088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:23.028518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66064b-2df2-41b0-9573-caf661d60b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.029221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66064b-2df2-41b0-9573-caf661d60b6e None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.029507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66064b-2df2-41b0-9573-caf661d60b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.029793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66064b-2df2-41b0-9573-caf661d60b6e None admin] PATH_INFO: `/v3/projects/1511155764c640988e6e51d316abf862/groups/5e11243d8f5f4c6883ba2a63602d8256/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.032118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66064b-2df2-41b0-9573-caf661d60b6e None admin] RBAC: Authorizing `identity:create_grant(project_id=1511155764c640988e6e51d316abf862, group_id=5e11243d8f5f4c6883ba2a63602d8256, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:23.033592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66064b-2df2-41b0-9573-caf661d60b6e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:23.066403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b510d8-74aa-4d1d-8d17-25e49c498e80 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.095030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:23.102691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.103518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.104005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.104313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.108928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 207/419] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 25 22:34:22 2022] PUT /identity/v3/projects/1511155764c640988e6e51d316abf862/groups/5e11243d8f5f4c6883ba2a63602d8256/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:23.118252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce837-ebbb-44de-8e14-2763dd3c23a9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.119415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce837-ebbb-44de-8e14-2763dd3c23a9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.119962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce837-ebbb-44de-8e14-2763dd3c23a9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.122498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 208/420] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:23.128103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.128662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.129115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.167819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:23.170954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:23.224212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:23.227263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:23.309611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 209/421] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:23.335857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:23.396021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 213/422] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:34:23.397577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:23.428682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:23.447610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed3b9-8fbe-4784-ae56-ae9b14944e57 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.450258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:23.483474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.484168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.484491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.484794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.496961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:23.502958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:23.503876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:23.505168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 210/423] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:23.510952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:23.515156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806638-993d-4073-bf8f-2d27287cdff3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.552943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.553635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.553921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.554199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.555816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:23.558278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:23.563794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 214/424] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:23 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:23.566385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:23.621341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658bb1-24a6-49ad-8019-3bae0ff5b9c4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.673904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3ee7c-c9a8-445e-92c1-fcca0849504f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.676113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:23.678498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.679188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.679482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.679786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.680552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:23.680861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:23.682843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:23.707478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 211/425] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:23.713555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:23.715715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.716645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.717131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.717600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.718982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:23.720761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:23.727640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 215/426] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:23 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:23.729297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:23.767641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:23.839241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188687-7e36-4eeb-8bc4-f17a49332ae8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.877588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.879039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.879520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.880020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.881050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:23.881567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:23.883511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e360c2-c6b3-4de3-8a21-c833e40eea0c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:23.895918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 216/427] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:23 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:23.930733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b17-c108-4a76-982f-cfcbb8f34017 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:23.935055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696ac1-bad1-4178-8ede-8147cd56ef92 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.935609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696ac1-bad1-4178-8ede-8147cd56ef92 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.936142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696ac1-bad1-4178-8ede-8147cd56ef92 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.937959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 217/428] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:23.945090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.945667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.946138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:23.978642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:23.981045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:23.996919 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:23.997926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:23.998434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:23.999279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.028191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.103517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 218/429] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:24.117489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:24.119859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:24.136829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.154532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.246218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 212/430] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:34:24.250773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320829-0fc3-4ccb-abfe-e5b87dfd7809 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:24.252095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.297605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:24.299286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.299286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.299286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.317034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:24.323471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:24.324371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:24.325150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 219/431] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:24.334868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.362059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.394851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475d36-191b-4fc2-b2b1-1b1900b9244f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:24.433061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.448600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:24.449723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.450016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.450295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] PATH_INFO: `/v3/projects/b9e8c574b54d4a55bf9d20699942aa77` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.451938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] RBAC: Authorizing `identity:get_project(project_id=b9e8c574b54d4a55bf9d20699942aa77)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:24.453392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:24.455837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 213/432] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/projects/b9e8c574b54d4a55bf9d20699942aa77 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:24.461101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.486755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5800f7-1a4f-470a-8338-f65d8358f186 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:24.529126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:24.529970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.530396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.530813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.531707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] RBAC: Adding query filter params (name=member) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:24.532218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:24.533738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:24.544282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 220/433] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:24.549473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.584025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e70a-1ae6-4084-940a-d0923abf4b4c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:24.635803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:24.636763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.637189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.637608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.641805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:24.643974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:24.645986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 214/434] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:24.652326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.668136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.689330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4abdc-74fd-482d-89c2-65b456ee5031 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:24.726543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.731585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df4965-df11-4fcc-8c6a-4a4343ac2c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:24.732740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4965-df11-4fcc-8c6a-4a4343ac2c80 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.732740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4965-df11-4fcc-8c6a-4a4343ac2c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.733086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4965-df11-4fcc-8c6a-4a4343ac2c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.785028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0af2ca-303b-4f05-9aaa-02b762b863a2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:24.808829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df4965-df11-4fcc-8c6a-4a4343ac2c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:24.810431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df4965-df11-4fcc-8c6a-4a4343ac2c80 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:24.834053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:24.835010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.835586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.836049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.837306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=b9e8c574b54d4a55bf9d20699942aa77) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:24.838419 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:24.840573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:24.849835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 215/435] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=b9e8c574b54d4a55bf9d20699942aa77&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:24.910148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:24.934575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 221/436] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:24.940362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:24.947661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8184-2ea7-4ccf-aac6-ebd22e2c3195 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.948507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8184-2ea7-4ccf-aac6-ebd22e2c3195 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.949054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8184-2ea7-4ccf-aac6-ebd22e2c3195 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.950940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 222/437] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:24.956740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:24.957027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:24.957306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:24.977455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:24.979590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:25.067856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 223/438] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:25.082885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f25b5-ef36-4678-b448-ff185b859d61 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.085594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.125501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:25.140599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.141579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.142035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.142138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.143438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:25.145134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:25.147131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 216/439] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:24 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:25.154448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.205299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6684fac-3e90-4b6a-b813-b0fb68641f2b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.219270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:25.271962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.272644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.272934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.273232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.292490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:25.299727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:25.300689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:25.301480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:25.302154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e09b5-0d76-419e-8f87-ec7dcf81c492 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.302227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 224/440] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:25.308287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.345648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.346635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.346953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.347240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.348455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:25.349990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:25.356524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 217/441] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:25.357561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.423316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:25.425098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb308-cac9-484f-89ce-51889c23ad46 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.463092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.463733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.464093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.464375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.464831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b0d3-c96c-4e71-bbcd-25debaeda84c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.465108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:25.465416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:25.467132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:25.481253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 225/442] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:25.482347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.499083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.499710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.500024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.500308 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.501109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=2f3be5e1b4134b18b93f08ffd7566aa9, scope.project.id=f82d09c494574602ae59009847734816) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:25.501424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:25.502864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a792cb-dd9d-4080-bc2f-7151647578a3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:25.509071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 218/443] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=f82d09c494574602ae59009847734816&role.id=2f3be5e1b4134b18b93f08ffd7566aa9 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:25.529931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:25.611070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b5e3-d8ad-4420-bd6f-743a3be56eb1 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.641967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adedd42-ca67-4ecf-8317-72d5fd63872f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.642573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adedd42-ca67-4ecf-8317-72d5fd63872f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.642931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adedd42-ca67-4ecf-8317-72d5fd63872f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.644443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 219/444] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:25.648002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.648646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.648998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.649283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.650876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.651234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.651585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.672227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:25.673441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:25.737664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:25.739206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:25.758160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 220/445] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:25.777187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:25.780996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.856708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:25.859334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 226/446] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:25.869782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.907453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373ebe2-f3c1-4021-9f31-e93c7ff0ab05 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:25.941885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:25.942562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:25.942863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:25.943140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:25.954075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:25.958887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:25.959866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:25.960708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:25.964059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 221/447] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:25.966780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:25.974885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839dc8a-617b-43ea-bedd-58947f66a88e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.004745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:26.010100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.010748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.011050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.013071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] PATH_INFO: `/v3/projects/f82d09c494574602ae59009847734816` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.013071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] RBAC: Authorizing `identity:get_project(project_id=f82d09c494574602ae59009847734816)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.014086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.020135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 227/448] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/projects/f82d09c494574602ae59009847734816 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:26.021084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:26.068069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991f8ff-c506-49f3-9878-ff9639388a06 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.085840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:26.105949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.106577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.106865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.107143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.107906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:26.108215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.109593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.117991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 222/449] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:26.123815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:26.123989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b7ad-1716-4887-9426-e2e4ef8a062a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.158762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.159400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.159688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.159995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] PATH_INFO: `/v3/groups/8545c6d040ac43df935dce91a20e064c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.161162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] RBAC: Authorizing `identity:get_group(group_id=8545c6d040ac43df935dce91a20e064c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.162864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.164495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 228/450] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:26 2022] GET /identity/v3/groups/8545c6d040ac43df935dce91a20e064c => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:26.170211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:26.223127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63088c8-30e2-4916-b192-fc1693d5e7b5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.237574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:26.256484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.257101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.257391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.264558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.270422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357de4bb-bea0-43c4-b2e1-3e10c7707135 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.304453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:26.309377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.310002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.310332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.310644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.311502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] RBAC: Adding query filter params (group.id=8545c6d040ac43df935dce91a20e064c, role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=f82d09c494574602ae59009847734816) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:26.311857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.313368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.319379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 229/451] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:26 2022] GET /identity/v3/role_assignments?group.id=8545c6d040ac43df935dce91a20e064c&scope.project.id=f82d09c494574602ae59009847734816&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:26.327081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.328627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.436682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 223/452] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:34:26.442621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:26.548937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07638-2950-479f-9467-a3354276e5b6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.578147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:26.582968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.583616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.583940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.584228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] PATH_INFO: `/v3/projects/1511155764c640988e6e51d316abf862` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.585411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1511155764c640988e6e51d316abf862)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.586857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.589311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 230/453] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:34:26 2022] GET /identity/v3/projects/1511155764c640988e6e51d316abf862 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:26.594835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:26.677089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:26.698834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92435e-1819-4f87-b85e-a932f93f0f9a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.732455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58d99-f2a3-4b30-94c8-88c3e15dc6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.733081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58d99-f2a3-4b30-94c8-88c3e15dc6b8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.733369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58d99-f2a3-4b30-94c8-88c3e15dc6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.733651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58d99-f2a3-4b30-94c8-88c3e15dc6b8 None admin] PATH_INFO: `/v3/groups/5e11243d8f5f4c6883ba2a63602d8256` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.734799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58d99-f2a3-4b30-94c8-88c3e15dc6b8 None admin] RBAC: Authorizing `identity:get_group(group_id=5e11243d8f5f4c6883ba2a63602d8256)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.736276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58d99-f2a3-4b30-94c8-88c3e15dc6b8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.737863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 224/454] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 25 22:34:26 2022] GET /identity/v3/groups/5e11243d8f5f4c6883ba2a63602d8256 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:26.744466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:26.841425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05b708-343a-45da-828e-f3ef57aa36a0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:26.873967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:26.874573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:26.874858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:26.875135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:26.875957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] RBAC: Adding query filter params (group.id=5e11243d8f5f4c6883ba2a63602d8256, role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=1511155764c640988e6e51d316abf862) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:26.876271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:26.877701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f99f-5609-4c2e-b02b-130cc362c32a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:26.883304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 231/455] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 25 22:34:26 2022] GET /identity/v3/role_assignments?group.id=5e11243d8f5f4c6883ba2a63602d8256&scope.project.id=1511155764c640988e6e51d316abf862&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:29.341880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286676-497b-49c9-9ea2-88e01a29a676 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.342383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286676-497b-49c9-9ea2-88e01a29a676 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.342457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286676-497b-49c9-9ea2-88e01a29a676 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.344074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 225/456] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:29.349422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823610-283a-45d7-b67e-bcd67c2a50bb None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.349806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823610-283a-45d7-b67e-bcd67c2a50bb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.349980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823610-283a-45d7-b67e-bcd67c2a50bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.376698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-85823610-283a-45d7-b67e-bcd67c2a50bb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:29.377905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-85823610-283a-45d7-b67e-bcd67c2a50bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:29.451245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:29.464622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 232/457] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:34:29.509098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286676-497b-49c9-9ea2-88e01a29a676 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:29.545829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43badc37-56e4-4c88-9297-63c3d3af14e2 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.546082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43badc37-56e4-4c88-9297-63c3d3af14e2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.546360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43badc37-56e4-4c88-9297-63c3d3af14e2 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.547792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 233/458] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:29.552922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.553138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.553415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.578550 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:29.579997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:29.649046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 234/459] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:29.674421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:29.686418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286676-497b-49c9-9ea2-88e01a29a676 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:29.753950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:29.754615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.754903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.755184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.771089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:29.772648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:29.783164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06655e0-e270-40e1-9466-f93a6c69a957 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:29.787731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:29.806273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:29.807223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:29.812923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:29.812923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:29.812923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:29.812923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:29.816863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 226/460] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:29.819168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:29.828846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:29.831351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:29.832276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.833427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.834095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.845463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:29.847429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-30612444-896c-42fb-b705-43c054b3bba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:29.864187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:29.865032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:29.865871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:29.865871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:29.865871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:29.865871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:29.868117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 235/461] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:29.869557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d12232-d3ad-48ef-ab5c-dfdd329627db None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.870119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d12232-d3ad-48ef-ab5c-dfdd329627db None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.870675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d12232-d3ad-48ef-ab5c-dfdd329627db None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.872395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 236/462] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:29.873810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d12232-d3ad-48ef-ab5c-dfdd329627db None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:29.941970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936886b-828d-49e7-8ecd-b67a4a6e0890 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:29.977382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:29.978301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:29.978772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:29.979871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:29.980787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:29.981293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:29.982860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac776a-9d2d-4ead-879c-7b334ee9c303 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:29.983669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d12232-d3ad-48ef-ab5c-dfdd329627db None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.001860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 227/463] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:30.003391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.003964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.004451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.023503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:30.024513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.025140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.025422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.025698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.026048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:30.026456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:30.026742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.028418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.041914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 237/464] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:30.042871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.080843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:30.084128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:30.099034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 228/465] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:30.108855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.151769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a9f2-87e1-4fed-9664-a5d4c92fe1b8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.188812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.189559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.189848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.190121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.190809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.192287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.233677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9287e-2254-42e4-b0f3-bd17f0c42a6b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.266675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529ccfc-2d63-4de4-9bd4-f683b980b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.267290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529ccfc-2d63-4de4-9bd4-f683b980b610 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.267569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529ccfc-2d63-4de4-9bd4-f683b980b610 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.267874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529ccfc-2d63-4de4-9bd4-f683b980b610 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.268552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529ccfc-2d63-4de4-9bd4-f683b980b610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.269981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529ccfc-2d63-4de4-9bd4-f683b980b610 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.295185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 238/466] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/users => generated 246 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:30.298270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.368242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 229/467] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:30.370462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b870a5-a73c-4818-a995-6547c4d7e2bc None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.371228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b870a5-a73c-4818-a995-6547c4d7e2bc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.371655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b870a5-a73c-4818-a995-6547c4d7e2bc None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.374543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 230/468] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:30.380307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.381217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.381659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.423876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:30.425289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:30.476732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:30.497266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:30.507428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981359e4-b8c0-4765-a581-27f93bc0fb77 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.512524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 231/469] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:30.539490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.552411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.553453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.553555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.553803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.568382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.569181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:30.587291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:30.588388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:30.589260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:30.589260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:30.589260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:30.589260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:30.589260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 239/470] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:30.596913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.659063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d01065-b539-4627-92d6-f039ff439ecc None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.716878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.717542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.717827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.718105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.738514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.740034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.742501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2420747-09a9-403b-bac3-7ed93f3cd7b4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f40b14a4-1a36-4234-9bc6-e35b0be9cbf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:30.770672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:30.771578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:30.772455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:30.772455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:30.772455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:30.772455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:30.772667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 232/471] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:30.774109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989163b-aa41-4059-b567-15cb84ca1b70 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.774265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989163b-aa41-4059-b567-15cb84ca1b70 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.774521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989163b-aa41-4059-b567-15cb84ca1b70 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.776134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 233/472] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:30.778946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989163b-aa41-4059-b567-15cb84ca1b70 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.795087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.795725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.796103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.796466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.797254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:30.797572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.799141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa3d4b-432f-4baa-a825-ad8feb149435 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.816012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 240/473] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:30.817270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.817561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.817842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.822231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:30.829427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:30.843387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:30.845022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:30.909524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989163b-aa41-4059-b567-15cb84ca1b70 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:30.935799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 241/474] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:30.935799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:30.970595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:30.971705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:30.972299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:30.972784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:30.973695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:30.974207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:30.976073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:30.996372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 234/475] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:30.997760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:31.058426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec92cb-f3e5-42c8-98c4-a11074005da6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:31.105296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:31.106313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:31.106828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:31.107306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:31.108385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:31.110046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:31.113813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:31.119578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:31.131862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a7f1-7ee2-419a-b8c3-4328988195dc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:31.172713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:31.173398 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:31.173921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:31.174402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:31.175736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:31.177874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:31.207638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 242/476] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/users => generated 248 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:31.207638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:31.210704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.sql.core [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:34:31.210704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 22:34:31.210704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [parameters: {'id': 'e79ed5df527248b38eeb1181c28b5b95', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 22:34:31.210704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result.read() Jul 25 22:34:31.241719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:34:31.242640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application yield resource Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise self.value Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application session.commit() Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:34:31.243558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:34:31.244422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:34:31.245539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result.read() Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:34:31.247195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [parameters: {'id': 'e79ed5df527248b38eeb1181c28b5b95', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:31.249508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 22:34:31.251413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:31.254163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 235/477] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 25 22:34:30 2022] POST /identity/v3/roles => generated 144 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:31.261427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:31.381424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b771b67-2538-4911-93a2-7864326cf3a4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:31.431368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:31.433141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:31.433663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:31.434140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:31.435053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:31.437245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:31.487945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c323-7bae-4347-9760-d1e5cda228a4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:31.531751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a4157-5e13-43ea-a7ba-db9efdbfdb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:31.532427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4157-5e13-43ea-a7ba-db9efdbfdb16 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:31.532710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4157-5e13-43ea-a7ba-db9efdbfdb16 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:31.532987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4157-5e13-43ea-a7ba-db9efdbfdb16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:31.547916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 243/478] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:31 2022] POST /identity/v3/users => generated 249 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:31.554394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a4157-5e13-43ea-a7ba-db9efdbfdb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8d2a4157-5e13-43ea-a7ba-db9efdbfdb16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:31.560817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:31.561863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:31.563198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 236/479] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:34:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:31.569643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:31.724915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:31.788562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafee677-9714-4ea5-89b2-405a5d35f6d3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:31.843427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:31.848296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:31.851785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:31.851785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:31.851785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:31.851785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:31.852154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d8b3a-b7d2-411e-90aa-2f8bf297d5cf None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:31.868867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 244/480] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:33.015956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b0d3-0374-44b4-974c-6946f4de4d7a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.016895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b0d3-0374-44b4-974c-6946f4de4d7a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.018262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b0d3-0374-44b4-974c-6946f4de4d7a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.028634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 237/481] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:33.028634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8542b-0868-4009-9d8e-54a030c8ee8c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.028634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8542b-0868-4009-9d8e-54a030c8ee8c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.028634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8542b-0868-4009-9d8e-54a030c8ee8c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.028634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 238/482] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:33.029552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.030361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.032071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.032558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.033025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.036756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.067455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:33.071846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:33.071962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:33.073261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:33.078136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:33.199869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 239/483] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:33.202608 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 245/484] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:33.243100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:33.245472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:33.319729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:33.397749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a6bce-39c4-4c77-a1a6-85fa9322d167 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:33.443445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556cf8-81bb-45fd-af97-2b758594942c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:33.490977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:33.491646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.493267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.493267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.494137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:33.494137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.495141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.497643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.515724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:33.521118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:33.521972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:33.522765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:33.523352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:33.524173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:33.528685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:33.530875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:33.535729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:33.537489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 240/485] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:33.537489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:33.537748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 246/486] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:33.537748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:33.658053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876d75-9cd0-4573-b32c-14e9f46aa696 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:33.693205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:33.693835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.694135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.694413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.695151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:33.695464 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:33.696922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:33.705488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 241/487] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:33.710852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:33.789504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:33.795575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3427b2-10b9-47f0-98d3-bc8c26b06f4b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:33.805307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:33.841642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1c2c-c026-4f6c-b53f-daa22a5f288a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:33.847604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:33.848028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.848528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.849020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.850100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:33.850520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:33.852055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018e6e9-117b-4b07-994d-d604c3afc5b3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:33.861352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 247/488] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:33.862726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff95660-e109-452c-a343-7d1d8d658eec None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.863125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff95660-e109-452c-a343-7d1d8d658eec None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.863504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff95660-e109-452c-a343-7d1d8d658eec None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.865214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 248/489] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:33.871486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.872248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.872739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.886002 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:33.886796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:33.887087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:33.887368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:33.895330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:33.897348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:33.898773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:33.900401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:33.918678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:33.919548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:33.920468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:33.920468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:33.920468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:33.920468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:33.920468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 242/490] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:33.921180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:33.995779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 249/491] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:33.995779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.067276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1f6a3-8733-4d72-82f6-edf8ce588b55 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.084111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.111067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.111716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.112504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.112941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.112941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.125265 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1160f21-473f-4db5-8acc-496698e8b708 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.127569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.129910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:34.148404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:34.149361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:34.151466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:34.151466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:34.151466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:34.151466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:34.155469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 243/492] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:34.157325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.175850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.175850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.175850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.175850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.176243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:34.176243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.177673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.198854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 250/493] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:34.198854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.316865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c179-8a5c-4409-a121-5f2d6ce57f78 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.353608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.354746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54c5b-a619-4441-b57a-e724ca7da1e6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.354884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.355113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.355384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.366703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:34.372891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:34.373818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:34.374600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 244/494] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:34.375245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.398504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.399121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.399400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.399673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.400403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:34.401391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.403088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714148-f88c-40b3-8883-86dc359e778e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.408724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.415591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 251/495] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:34.417310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58a750-9aa6-48a2-93f4-a61d617f9695 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.417603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58a750-9aa6-48a2-93f4-a61d617f9695 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.417894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58a750-9aa6-48a2-93f4-a61d617f9695 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.419320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 252/496] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:34.420287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58a750-9aa6-48a2-93f4-a61d617f9695 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.434308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.489107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98cf9-124b-4918-9992-64d121e0158c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.524080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.524727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.525017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.525296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.527128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58a750-9aa6-48a2-93f4-a61d617f9695 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.532784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.534360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7ef16575-f22c-4168-aeee-51169c5e7e05 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:34.547118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:34.548216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:34:34.549467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:34.551901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 245/497] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:34.553411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80059e-876d-4483-81ab-ee9145628845 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.553704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80059e-876d-4483-81ab-ee9145628845 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.553980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80059e-876d-4483-81ab-ee9145628845 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.555250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 246/498] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:34.555958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80059e-876d-4483-81ab-ee9145628845 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.563190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.563857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.564146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.564423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.565154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:34.565462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.566837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f46f-b8de-46ad-a2cb-173a1834bd90 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.575634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 253/499] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:34.576834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.577153 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.577433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.595296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:34.596534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:34.648425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.663827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 254/500] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:34.675882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.675985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80059e-876d-4483-81ab-ee9145628845 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.676067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.710779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.711360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.711620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.711925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.719565 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.721095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0b4b4716-86d2-410a-a6fc-5b7fad551ce3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:34.732362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:34.733367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:34.734363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 247/501] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:34.734965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.735164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.735486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.754262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:34.755514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:34.768374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a8fc3-d601-4538-8f98-dfb764f4f444 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.801819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.802434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.802721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.803006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.803834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:34.804150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.805581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.824817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 248/502] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:34.825656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.853561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 255/503] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:34.853561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:34.907516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.909810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:34.930388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee272d5-96f3-4192-911b-16a020ef0b42 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.949880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d816-2548-4922-8658-fc571ebfd13d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:34.965042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.965684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.966021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.966296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.979968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.982249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:34.986024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:34.986721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:34.987068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:34.987353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:34.997976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:34.998095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:34.999019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:34.999900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:34.999900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:34.999900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:34.999900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:34.999900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 249/504] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:35.000180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.000249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:35.015388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:35.016323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:35.017163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:35.017163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:35.017163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:35.017163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:35.017163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 256/505] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:35.017438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.106544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019573d5-dc75-479f-a47d-74eec5df1f50 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.115572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea4653-3083-4972-b5c5-52e55e906188 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.128876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.133611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.141928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.142560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.142981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.143272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.144115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:35.144483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.145954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.151634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.152334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.152618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.152892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.164300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:35.169794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:35.170794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 257/506] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:35.171968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.186012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 250/507] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:34:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:35.186854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.273856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e3173-6bcb-4469-8c73-556a5d3e505c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.287746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ce93-c008-4627-838e-a27732b6271e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.308257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.309385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.309385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.309599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.324291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.324918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.325204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.325489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.326234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:35.326542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.328035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.341613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 251/508] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:35.342880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.351653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.377875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.379347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.391973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.448803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a386cc-4251-41c1-b89d-3894edcddb21 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.484352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 258/509] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:35.484352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.484624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.484624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.484624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.484624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.484920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:35.484920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.486509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.501464 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 252/510] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:35.502271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.560253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.588993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455ea1-fab5-4ccc-8ab4-034cb461c23c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.600965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be25a6-8dad-48b0-aeff-b3d2ed4c8151 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.608727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.625234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.625853 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.626138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.626418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.627137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:35.627452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.628866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.635920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.636542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.636828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.637156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.641850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 259/511] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:35.641850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.708100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.709570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.738975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083bf6-b6d9-41ad-aedb-7acbc57f5aa5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.772623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.773258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.773554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.773832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.776183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.782801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.784278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:35.798868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:35.800097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 260/512] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:35.801207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.814004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 253/513] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:35.814764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:35.822968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:35.905838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60271e-d786-4911-9abb-3f9ee8131c66 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.913302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b455-d479-472f-99df-b890fb851925 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:35.941144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.941783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.942068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.942345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.948899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:35.949514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:35.949802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:35.950084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:35.950770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.952255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.953198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:35.954653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:35.969214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:35.970212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:35.971262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:35.971262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:35.971262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:35.971262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:35.971904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 261/514] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:35.972708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.019446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.037158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 254/515] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:35 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:36.037980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.086349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c50075-2637-4d42-b050-c382adad9123 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.115820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.126323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.126991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.127282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.127561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.140414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.141916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:36.157617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:36.158539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:36.159382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:36.159382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:36.159382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:36.159382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:36.159382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 262/516] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:36.160034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.172408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e135f-8b71-4fdd-a1b7-61f0cf4e1f27 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.211933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.212667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.213702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.213883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.215097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:36.215097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.216552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.239357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 255/517] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:36.240589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.277858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.284238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5554c9-0290-4b43-a64b-9dbb5111d97a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.320202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.320849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.321144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.321421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.334039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.335630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:36.350678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:36.351579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:36.352457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:36.352457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:36.352457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:36.352457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:36.352457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 263/518] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:36.352735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.363575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568ebf-ab94-4d33-af64-9dbdf3141add None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.386774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.401731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.402356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.402646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.402923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.403621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:36.403956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.405345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.418377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 256/519] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:36.419397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.468322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551fab-3cc0-4464-85cf-eef9c8f80891 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.505196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.506229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.506522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.506852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.507685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:36.508036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.509421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.524247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 264/520] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:36.525097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.539129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f4ab0-53f9-4b69-ab58-e357a0cbcb87 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.540347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.577646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.578270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.578559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.578837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.631789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af72c2-ebf9-4303-90f7-061adc57a9b7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.632716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.654655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.656260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.667138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.667823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.668115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.668389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.669110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:36.669387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.670767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.682691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 265/521] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:36.683512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.762806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.772007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 257/522] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:36.772946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.799727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6625-6acc-495f-85a8-9bb72ab61310 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.836351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.837003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.837288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.837589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.845640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.847175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:36.860705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:36.861711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:36.862521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 266/523] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:36.862980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.864069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:36.886120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a33005-78c8-4efa-a47c-a4316d5377bf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:36.926786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:36.927436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:36.927741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:36.928041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:36.935660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:36.937241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:36.950062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:36.951017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:34:36.952106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:36.954166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 258/524] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:36.955063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:36.971929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06030-ae8c-4d5a-bf5e-1320c8bb4071 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.000481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.006519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.007165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.007456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.007740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.015058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.016552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:37.029515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:37.030566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:37.031410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 267/525] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:37.031994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.076577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ca06a-5df4-4eb3-afb8-eb01b900605e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.114712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.115598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.116051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.117149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.127424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.129911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.131734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.142868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f6d3-0e6f-4a39-b05d-98f86036a632 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:37.148822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:37.149656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:37.151173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:37.151173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:37.151173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:37.151173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:37.151910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 259/526] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:37.152222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.179678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.181054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.181404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.181740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.182540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:37.182851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.184772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.208284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 268/527] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:37.208284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.258196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.273336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53383e-3398-4ca2-ae8f-1322bf4e90aa None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.314352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d855bd-8236-44f8-a006-539060fa3387 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.320315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.320939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.321219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.321493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.322741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:37.323053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.324869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.351339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 260/528] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:37.351339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.352448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.353074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.353362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.354176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.355035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:37.355353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.356837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.374779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 269/529] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:37.374779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.410449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.463650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2f5c1-f22c-40ab-a7bb-e6cb1286d09d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.473229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff97bc-ff6b-4605-a818-e9b04b588e93 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.484210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.498881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.499505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.499810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.500090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.500788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:37.501093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.502470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.508196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.508817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.509110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.509399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.510441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=e9a8f7e27170404ebf1a2be70efe63fe) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:37.510925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.512659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.519346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 261/530] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:37.519346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.529438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 270/531] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/role_assignments?user.id=e9a8f7e27170404ebf1a2be70efe63fe&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:37.529438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.633239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aef8e-dd7b-47c5-8969-81117a11e80c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.645247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.657524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdb7d-a705-480f-8cfb-fc9a770a31f3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.672799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.673463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.673834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.674170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.697888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.698821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.699250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.699667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.700657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=f27a1a3e92fa4293a57b8b4024d065b5) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:37.701109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.702753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.708755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 271/532] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/role_assignments?user.id=f27a1a3e92fa4293a57b8b4024d065b5&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:37.709570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:37.788741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.790228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.798614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:37.861991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cf79d-fde9-400d-aa88-52b6f9030f3e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:37.899394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:37.900252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:37.901192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:37.901571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:37.909469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:37.911418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:37.925166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:37.926237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:37.927279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:37.929028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 272/533] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:37.940206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.007221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 262/534] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:38.015115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.034301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:38.062109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:38.066532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34bf46-78d8-44a3-a314-4a013f14baae None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.114229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.115028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.115427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.115872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.116694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:38.117216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.118892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977ceda-866b-4206-9e7b-85f7954e7fb2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.132552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 273/535] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:38.133982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf26c0-771c-4870-bdb1-0b1d487728ac None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.134374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf26c0-771c-4870-bdb1-0b1d487728ac None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.135383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf26c0-771c-4870-bdb1-0b1d487728ac None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.137640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 274/536] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:38.138579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf26c0-771c-4870-bdb1-0b1d487728ac None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.170122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd70ef-4573-45d7-a008-aee8388aa57f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.208455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.209028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.209314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.209591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.220645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.222102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c4c3158f-1aea-470f-a141-baf6cffd8d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:38.238682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:38.240658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 263/537] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.242735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.256823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf26c0-771c-4870-bdb1-0b1d487728ac None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.262009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:38.263219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:38.308046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.309176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.309633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.310126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.311099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=4957fb8ec82d40f985b586cda019a0ab) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:38.311687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.313589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.320464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 275/538] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/role_assignments?user.id=4957fb8ec82d40f985b586cda019a0ab&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:38.321511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.328601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:38.341175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 264/539] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:38.355662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:38.372824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.444228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b829583-6728-4a5f-81af-05b8702d511b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.486470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.487020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.487305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.487582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.488342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:38.488683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.490246 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.505251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 276/540] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:38.511053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.553173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b01f52-a535-4679-b80b-8f8e3769514e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.600339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:38.603151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.605206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.614483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.614483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.620007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0887-72ac-4d2c-831c-4e53dfcb0855 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.620883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:38.627038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:38.628140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:38.629111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:38.631864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 265/541] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:38.642699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.663469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.664251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.664611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.665290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.674086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.676050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:38.690232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:38.691299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:38.692374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:38.693931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 277/542] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:38.700159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.763460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:38.864282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287192d-352f-4db8-a667-70b797bfd2cb None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.872310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c9305-acb8-4e3f-85fd-3c42aa5a3ef0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:38.917021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.917650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.917972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.918273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.919067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:38.919380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.920873 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.930416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 266/543] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:38.936772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.944791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:38.945418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:38.945701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:38.945979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:38.946753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:38.947064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:38.949146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:38.962003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 278/544] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:38.972867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:38.975798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:39.109397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328994-7482-429f-8b3b-62621d3ffe60 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:39.112165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755a862-8859-4c37-a9a5-922040223509 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:39.148328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:39.157594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:39.158258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.158543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.158821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.177537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:39.178181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.178461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.178736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.179535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=d361924fd6fc4cf2891d60fcad455a44) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:39.179876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:39.181331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:39.184435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:39.185904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:39.197184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 279/545] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/role_assignments?user.id=d361924fd6fc4cf2891d60fcad455a44&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:39.205659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:39.206575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:39.207472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:39.207472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:39.207472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:39.207472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:39.214228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 267/546] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:39.220927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:39.346650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:39.404602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4809a0a-8635-4ec1-8861-59196a90fd19 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:39.449852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:39.450879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.451391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.451914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.452867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:39.453413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:39.455154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:39.474081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 280/547] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:39.480026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:39.626264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4a123-a2a3-46d3-b87c-55ea36df7100 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:39.683143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:39.684316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.684816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.685287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.698255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:39.700135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-51ef3304-d432-4b41-a6ee-cab4a440c022 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:39.717601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:39.718724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:39.719613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:39.722322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 268/548] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:39.727703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:39.878592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ed39-488e-4363-909f-22aeef9d0e3c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:39.890543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3690a1c-b225-47a2-908a-44cff47c4e3e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.890946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3690a1c-b225-47a2-908a-44cff47c4e3e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.891120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3690a1c-b225-47a2-908a-44cff47c4e3e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.892742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 269/549] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:39.905938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.906280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.906501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.909269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:39.928315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:39.928955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:39.929244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:39.929523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:39.930347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:39.930660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:39.932711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:39.944827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:39.945995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:39.972695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 281/550] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 25 22:34:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:39.979230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:39.988110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.039193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 270/551] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:40.070378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.183229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254e42b-fbac-46b6-aa99-3a580e6731a9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.220524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.221308 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.221632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.222015 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.234132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:40.239507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:40.241374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:40.243083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:40.245812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 271/552] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:40.253608 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017494-141b-41de-b9a0-9aff8910fd41 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.256849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.285175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.302345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c594c6-6a42-4bad-b40e-d716c15a71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.302994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c594c6-6a42-4bad-b40e-d716c15a71c5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.312392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c594c6-6a42-4bad-b40e-d716c15a71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.312392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c594c6-6a42-4bad-b40e-d716c15a71c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.361412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.377714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c594c6-6a42-4bad-b40e-d716c15a71c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:40.379191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c594c6-6a42-4bad-b40e-d716c15a71c5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:40.423387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e51c4-e1df-4451-83b3-f2383b8d8eec None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.469861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.470926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.471506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.472006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.472925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:40.473449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:40.475239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:40.489845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 282/554] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:40.490175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 272/554] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:40.491237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575dc8b-a455-4a33-a799-775e782756fb None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.491614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575dc8b-a455-4a33-a799-775e782756fb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.491718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.491918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575dc8b-a455-4a33-a799-775e782756fb None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.493525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 283/555] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:40.494276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575dc8b-a455-4a33-a799-775e782756fb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.580501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.583629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.601448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575dc8b-a455-4a33-a799-775e782756fb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.606990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fcfbc-84d9-4fe6-9643-53d4c1cb7ebb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.639225 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.639917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.640254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.640540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.646843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.647838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.648322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.648817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.652995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:40.654487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:40.662845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:40.666578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-00b4811c-cebf-4c83-b0e1-a4b651eda7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:40.671909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:40.672768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:40.673698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:40.673698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:40.673698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:40.673698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:40.677717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 284/556] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:40.679098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.679397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.679677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:40.687272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:40.688178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:40.689489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:40.689489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:40.689489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:40.689489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:40.691729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 273/557] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:40.692905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.703497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:40.704854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:40.778239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 285/558] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:40.779057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.810269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d5d2e-6141-4ef3-a03b-2907cfa4da6f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.842104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.847577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:40.849994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.851029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.851512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.851980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.857674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:40.857674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:40.857674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:40.868588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 274/559] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:40.870432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.888777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672258dd-3cf4-401c-a2ee-f68ba3217626 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:40.927975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:40.928612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:40.928896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:40.929537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:40.929874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:40.930181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:40.932382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:40.944560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 286/560] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:40.945226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:40.987228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01932-2ed9-4e3a-8208-1e2f8c333097 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.022409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6881ab3-dbea-4f0e-b654-759c40083179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.023057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6881ab3-dbea-4f0e-b654-759c40083179 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.023387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6881ab3-dbea-4f0e-b654-759c40083179 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.023674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6881ab3-dbea-4f0e-b654-759c40083179 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.040670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6881ab3-dbea-4f0e-b654-759c40083179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f6881ab3-dbea-4f0e-b654-759c40083179 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:41.041881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:41.042966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:41.044029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:41.045989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 275/561] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:41.047054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e145b8a-418f-48ad-a491-234410ba4332 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.047457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e145b8a-418f-48ad-a491-234410ba4332 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.050599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e145b8a-418f-48ad-a491-234410ba4332 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.050599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 276/562] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:41.050599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e145b8a-418f-48ad-a491-234410ba4332 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.059537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413468-e647-48df-a1a2-188f1a612a7c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.087810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.099069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.099969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.101648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.101648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.111731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.113067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.114006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:41.130191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:41.131348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:41.133116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 287/563] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:41.133701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.173127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e145b8a-418f-48ad-a491-234410ba4332 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.210755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.211431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.211710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.212010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.219120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.220579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3e5a3595-be92-4b7e-8c38-265fad5ed442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:41.232949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:41.239800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 277/564] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.240838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.241542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.253187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b139d40-8e40-4b35-9b49-496a06688ad5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.260307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:41.260307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:41.288762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.289390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.289680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.289961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.290747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:41.291062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.292495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.301687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 288/565] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:41.302636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.355791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 278/566] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:41.355791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.364925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.404228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.423024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e288ce-d670-4ee6-a4f7-878c11a177f5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.464978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.465863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.466185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.466478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.467294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:41.467605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.469137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.469933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bc31c-c9f5-47ed-a843-5c0735432a9b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.492704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 289/567] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:41.492704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.513761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.514445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.514701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.514977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.515742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:41.516093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.517550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.542389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 279/568] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:41.542389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.606433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb5be-3cd8-4426-9392-0f361baa4d68 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.614814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.644328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.645135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.645325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.645587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.646034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.648197 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa1c98-1fd8-4ce6-9800-69f61a8b93f7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.658158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.659857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:41.675129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:41.676135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:41.677063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:41.677063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:41.677063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:41.677063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:41.677063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 290/569] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:41.677063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.688545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.689189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.689479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.689761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.700824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:41.705802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:41.706743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 280/570] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:41.707850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.784226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b649a7-3659-4fa8-a14c-c2f55d4a1cf5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.808022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e836f8-12e1-4aec-85bc-83b7b261d27d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.818584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.819304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.819689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.820067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.830746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.832238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.841696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:41.842313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.842598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.842875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.843670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=702abbf0ba844ec99db46a7b0c54b288) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:41.844011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:41.845434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-cdb45315-1ce5-4911-8a0a-9c07d8811496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:41.846680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:41.847572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:41.848730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:41.848730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:41.848730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:41.848730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:41.848730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 291/571] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:41.849001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0b5e-ffef-43f4-ae31-68595f2eb8d6 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:41.849260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0b5e-ffef-43f4-ae31-68595f2eb8d6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:41.849537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e0b5e-ffef-43f4-ae31-68595f2eb8d6 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:41.850775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 292/572] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:41.851473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e0b5e-ffef-43f4-ae31-68595f2eb8d6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.871795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 281/573] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/role_assignments?user.id=702abbf0ba844ec99db46a7b0c54b288&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:41.871795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:41.874162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.888665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:41.976375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e0b5e-ffef-43f4-ae31-68595f2eb8d6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:41.979442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b436-5934-4164-8b06-c77f0a487155 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.018845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.019477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.020147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.020255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.020348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.020548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.020789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.020882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.021070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.021937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.022036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.022110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.022465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.023416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405fd30-1752-4d76-b8d1-11c3b090d52a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.031387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 282/574] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.032311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.038295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 293/575] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.039740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.040059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.040337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.061760 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:42.062193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:42.123973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.131811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.147785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 294/576] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:42.147785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.151216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bed59-96b7-417b-b836-5340dd0e7943 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.188901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.189523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.189815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.190097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.190795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.191107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.192530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.209849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 283/577] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.209849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.262194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0a8b3-38a7-44c8-ab65-53050c25606a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.299861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.300977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.301171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.301776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.312836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.314173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.324288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f8280-009c-4a76-ba7b-d494a51fbed3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:42.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:42.333172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:42.334335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:42.334335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:42.334335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:42.334335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:42.334335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 295/578] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:42.334335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.368904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.369895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.370182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.370453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.377876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.379331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.391128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:42.392193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:42.393266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 284/579] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:42.394538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.406277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.448901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc797b-bbf6-49ec-bc94-4a95e55bf57e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.486520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.487607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.488112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.488464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.500229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:42.501390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8584-49ab-43bd-929e-8d82daa90675 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:42.505684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:42.506620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:42.507445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:42.511878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 296/580] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:42.512882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.539686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.540439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.541356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.541694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.548795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.550345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:42.564645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:42.565715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:42.566801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:42.570628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 285/581] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:42.571510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.632457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e1c38-92d0-405e-9577-e2f186224cf0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.641115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.646998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.673775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.674933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.675632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.676120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.677132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.677882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.679693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.680150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51453c-c35b-4b5b-be2f-c65f934579f9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.692540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 297/582] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.698354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.716726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.717443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.717804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.718156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.719045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.719363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.720834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.743279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 286/583] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.745234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.817489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193cd1-1ba1-4611-8e4c-3f07e4746900 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.853135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.854625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.855009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.855384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.856238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.856646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.858116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.861424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9a9b-0df7-4aef-8410-71637befc497 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:42.866636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 298/584] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.867610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.889239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.902408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:42.903233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:42.903525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:42.903854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:42.904712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:42.905032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:42.906477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:42.906864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:42.924428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 287/585] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:42.924428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:42.993383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133197-770d-43b2-85b2-6037a2eb5fe9 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.032543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.033312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.033617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.033893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.036327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ff18-af9e-4bb0-8c10-bb3786370aab None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.043218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.048991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:43.058809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:43.059959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:34:43.061179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:43.064963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 299/586] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:43.065902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.076062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.076656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.076941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.077219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.091191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.092702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:43.107776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:43.108658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:43.109534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:43.109534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:43.109534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:43.109534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:43.109534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 288/587] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:43.109802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.151344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:43.184244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:43.190912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103131-c598-4555-9886-46406ac3d318 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.226853 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.227503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.227649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181f865-0840-4dbd-8105-61dd75c84547 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.228050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.228276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.241040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.242988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:43.262018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:43.262966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:43.264581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:43.264581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:43.264581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:43.264581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:43.264581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 300/588] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:43.268591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.269080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.269397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.269748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.270089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/e9a8f7e27170404ebf1a2be70efe63fe/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.288446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=e9a8f7e27170404ebf1a2be70efe63fe, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.290041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.347565 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 289/589] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:43 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/e9a8f7e27170404ebf1a2be70efe63fe/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:43.348620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.429309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82e6b6-c2c6-46f3-ac9d-112dd7df2ff0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.460569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:43.479635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f98a-1f6a-40b2-9a77-bd62158415fb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.484970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.485928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.486404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.486871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.487978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:43.488495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.490188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.513517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 301/590] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:43.514815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.518915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:43.526992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.527680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.535609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.535609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.535609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:43.535609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.535609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.544587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 290/591] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:43.545746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.638117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320fcac-320a-4414-876a-bac2b6236458 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.657103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd226a-aff0-4851-aa1a-f1d166b34fc3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.684073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.685232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.685675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.686129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.687651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:43.688135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.690154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.695557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.696373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.696867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.697975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.706533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 302/592] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:43.707656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.714504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.716162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.723883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:43.734180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:43.738400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:43.739527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:43.739527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:43.739527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:43.739527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:43.739527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 291/593] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:43.739527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.798198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:43.859232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7b1e-1cf4-4ced-a096-82e4bd4dac42 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.861027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b6e03-225d-4bac-810f-3f19fa076d4a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:43.903004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.903855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.904243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.904700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.905743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:43.906394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.906683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.906974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.913608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.915136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.916185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:43.917609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:43.927617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:43.928792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:34:43.929927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-36944c37-9d90-40c4-8020-ea92f25b0b78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:43.930534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:43.931371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:43.932461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:43.935283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 292/595] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:43.935470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 303/595] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:43.935967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:43.936489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02303d-df0d-48eb-9c5a-5bed03177519 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:43.936833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02303d-df0d-48eb-9c5a-5bed03177519 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:43.937057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02303d-df0d-48eb-9c5a-5bed03177519 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:43.940092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 304/596] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:43.940092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02303d-df0d-48eb-9c5a-5bed03177519 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.005834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.052701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257e935-27d7-4483-aca7-db0ad08133a5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.059893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02303d-df0d-48eb-9c5a-5bed03177519 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.086488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.092304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.092930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.093216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.093494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.094202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:44.094515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.095932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.098596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.099211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.099496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.099797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.100608 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:44.100916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.102452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9742e0-f9c2-48f9-854d-deb363ae035b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.109856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 293/597] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:44.115421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.125798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 305/598] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jul 25 22:34:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:44.127068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.127356 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.127630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.147117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:44.148373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:44.222903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 306/599] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:44.223667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.234259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74619e7-fb93-4532-a0a5-2c0d9b2ca4d4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.259355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.279658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.279658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.279658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.279658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.280058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:44.280058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.281071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.300408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 294/600] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:44.301303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.350315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c495-5db6-4b32-a58a-be767f64bcab None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.365427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.388708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.389590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.390018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.390476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.397191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.398631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:44.412750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:44.413680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:44.414565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 307/601] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:44.415287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.429442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395ae0-a04e-4dea-9ee7-a289da910e38 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.467257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.468199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.468621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.469048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.481148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.482522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:44.497602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:44.498706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:44.499791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:44.499791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:44.499791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:44.499791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:44.499791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 295/602] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:44.499791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.534890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257af01c-2b25-4fce-89ee-1f2b9cc19b6d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.538509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.577091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.577761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.578045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.578321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.590384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:44.595351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:44.596329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:44.597146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 308/603] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:44.597819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.624407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167329cd-6773-4682-ba54-7def9e9576e8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.633771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.662005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.662796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.663088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.663390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/f27a1a3e92fa4293a57b8b4024d065b5/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.680778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=f27a1a3e92fa4293a57b8b4024d065b5, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.683512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.706361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed41b-d64a-4a12-bc2b-a9f2dd704b5f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.741806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.742345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.742629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.742904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.743679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:44.745215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.746639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.764819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 296/604] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:44 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/f27a1a3e92fa4293a57b8b4024d065b5/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:44.766333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.767977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 309/605] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:44.768833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.885065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.898818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:44.906811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75286b6f-79ae-4777-8241-5198077e4a98 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.912189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d01e5-b66e-49df-ab83-9ac9abde3519 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:44.946857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.947713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.948385 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.948385 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.949061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:44.949438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.950746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.953775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:44.954403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:44.954689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:44.954967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:44.955698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:44.956047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:44.957711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:44.963694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 297/606] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:44.964763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:44.968918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 310/607] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:44.974848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.101807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77645cb-78f9-4066-925d-cadd80451449 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.107508 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605f4e-75e5-483e-a2b2-079763f5246f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.138585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.139543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.140022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.140455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/4957fb8ec82d40f985b586cda019a0ab/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.147642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.148433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.148815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.149192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.154570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:45.158934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=4957fb8ec82d40f985b586cda019a0ab, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.160872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.163626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.165535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:45.182609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:45.183833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:45.184942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:45.184942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:45.184942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:45.184942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:45.187880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 311/608] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:45.187880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.199988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:45.260266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 298/609] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:44 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/4957fb8ec82d40f985b586cda019a0ab/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:45.260266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.367855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb1f7b-f438-4065-a083-b1789351a40b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.443973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.444680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.445020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.445420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.456973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757ea7-7f6c-44ee-b0b6-7b90f40004c4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.457657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.459434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:45.473675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:45.474678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:45.475674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:45.483264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 312/610] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:45.485055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.496377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.497013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.497299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.497576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.498958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:45.499270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.500757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b4e94-b962-4c12-9028-e41a6040bc83 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.519405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 299/611] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:45.520717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd06fe-8d9c-4f7f-93db-f19582d7aa5c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.521015 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd06fe-8d9c-4f7f-93db-f19582d7aa5c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.521294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd06fe-8d9c-4f7f-93db-f19582d7aa5c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.522769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 300/612] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:45.527498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd06fe-8d9c-4f7f-93db-f19582d7aa5c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.577619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:45.588037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:45.627931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f923-253f-45db-b31d-d57988373495 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.655246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd06fe-8d9c-4f7f-93db-f19582d7aa5c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.676891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.678069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.678522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.678951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.680030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:45.680763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.682886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d1c2d-7ca5-4cd7-8f78-aa951ee667fc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.700028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.700820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.701373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.701532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 313/613] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:45.701696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.703204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084467-5491-4296-8364-991aef3dce56 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.703640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084467-5491-4296-8364-991aef3dce56 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.704077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084467-5491-4296-8364-991aef3dce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.711200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.713486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.724765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-cf084467-5491-4296-8364-991aef3dce56 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:45.725599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:45.726726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:45.727910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:45.729419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cf084467-5491-4296-8364-991aef3dce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:45.729971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 301/614] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:45.730895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.816871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 314/615] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:45.818028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084467-5491-4296-8364-991aef3dce56 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:45.851304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175814-49a9-4ac6-ab6b-c713a891ec09 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.863897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:45.891457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:45.904210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.905228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.905513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.905791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/d361924fd6fc4cf2891d60fcad455a44/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.928557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=d361924fd6fc4cf2891d60fcad455a44, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.930945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:45.939854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084467-5491-4296-8364-991aef3dce56 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:45.979261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:45.979914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:45.980199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:45.980470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:45.981282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:45.981592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:45.983051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:46.003789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 315/617] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 25 22:34:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:46.004108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 302/617] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:45 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/d361924fd6fc4cf2891d60fcad455a44/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:34:46.004816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.012730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.162000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cfc37-b9e5-4edd-a986-b393b9984610 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:46.204148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:46.238292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d15e4-621d-400c-8d09-7210b039f2f7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:46.245114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:46.245788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:46.246078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:46.246355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:46.269173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:46.274168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:46.275958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:46.277318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:46.280556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 316/618] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:46.284237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:46.284967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:46.285324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:46.285912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:46.292765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.301384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:46.302905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:46.319617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:46.321124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:46.323047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:46.323047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:46.323047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:46.323047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:46.323047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 303/619] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:46.328910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.355734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:46.453640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b7e4-0826-4092-b0e2-6d0247e43cb6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:46.490072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:46.490729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:46.490966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:46.491309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:46.492100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:46.492606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:46.494916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:46.508462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 304/620] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:46.508667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c7e1-8a63-4a20-b4df-7d26e81675be None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:46.517680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.545845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:46.546469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:46.546759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:46.547042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:46.547785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:46.549627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:46.551011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:46.569421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 317/621] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:46.576137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.641373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:46.666526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:46.727066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283caafd-0da8-40ca-8807-262a1012fd50 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:46.737914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baee90-882b-490e-bead-cfbaa72b1943 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:46.793092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:46.793764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:46.794052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:46.794328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:46.795883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:46.796759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:46.797249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:46.797729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:46.806524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:46.808510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:46.822945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:46.823959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:46.824834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:46.825309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:46.825309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:46.831947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 305/622] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:46.833810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:46.877805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:46.878804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:46.879696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:46.879696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:46.879696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:46.879696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:46.887557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 318/623] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:46.894033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:46.973358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e740fb4-02aa-482e-ac4b-8047a829593e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.008442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:47.015201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.016286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.017346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.017872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.019019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:47.019540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:47.021228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:47.041761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 306/624] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:47.044645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:47.124172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:47.162081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb300278-852b-4cf8-8a1a-0fa1e48f875b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.223362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56ae69-bca0-4b0f-8dd8-cbc7f090237c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.228798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.229434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.229720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.229997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.230705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:47.231011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:47.232441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f42402-b8ff-4dd5-a4c3-6635ae888ea0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:47.245721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 319/625] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:47.251466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef41-bf6b-4015-8efa-bd6ffb63d7ff None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.251784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef41-bf6b-4015-8efa-bd6ffb63d7ff None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.252083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef41-bf6b-4015-8efa-bd6ffb63d7ff None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.253895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 320/626] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:47.254672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef41-bf6b-4015-8efa-bd6ffb63d7ff None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:47.264478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90109c7-31dc-43e7-a176-05e93feeada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.265190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90109c7-31dc-43e7-a176-05e93feeada5 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.265476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90109c7-31dc-43e7-a176-05e93feeada5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.265803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90109c7-31dc-43e7-a176-05e93feeada5 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/702abbf0ba844ec99db46a7b0c54b288/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.282576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90109c7-31dc-43e7-a176-05e93feeada5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=702abbf0ba844ec99db46a7b0c54b288, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:47.284080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90109c7-31dc-43e7-a176-05e93feeada5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:47.387212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 307/627] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:34:47 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/702abbf0ba844ec99db46a7b0c54b288/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:34:47.389071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc861-38dc-4c73-8619-c6683716881f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.389659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc861-38dc-4c73-8619-c6683716881f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.389789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef41-bf6b-4015-8efa-bd6ffb63d7ff None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.390288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc861-38dc-4c73-8619-c6683716881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.414914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-811fc861-38dc-4c73-8619-c6683716881f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:47.416737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-811fc861-38dc-4c73-8619-c6683716881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:47.452007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.452727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.452998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.453358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.466076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:47.473092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:47.474773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:47.496840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:47.497947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:34:47.499362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:47.504180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 321/628] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:47.505165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:47.510382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 308/629] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:47.531842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:47.542317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc861-38dc-4c73-8619-c6683716881f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:47.682771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fbdd1-e04c-43fe-a13c-99029a08dcf0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.691019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc861-38dc-4c73-8619-c6683716881f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.721042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.721684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.722097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.722447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.723266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:47.723632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:47.725119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:47.735408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.736494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.737183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.737689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.747716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 322/630] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 25 22:34:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:47.752028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:47.757230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:47.758155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:47.758973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:47.760167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:47.762507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 309/631] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:47.768662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:47.804918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:47.871436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:47.887400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ebf4-030c-489d-98b9-133a80e9852b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.914262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96186d8-2832-48cc-bd04-8cc6c8d5d899 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:47.929760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.930738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.931742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.932376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.933838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:47.934433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:47.936413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af682-794e-4ca2-ae0b-2eca0714ad49 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:47.951231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 310/632] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:47.956785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3b5d-63a0-4df1-a23d-172186f5439e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.957017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3b5d-63a0-4df1-a23d-172186f5439e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.957829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3b5d-63a0-4df1-a23d-172186f5439e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.960302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976882b-6f9e-468e-a629-6419144db236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:47.960932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976882b-6f9e-468e-a629-6419144db236 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:47.961216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976882b-6f9e-468e-a629-6419144db236 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:47.961492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976882b-6f9e-468e-a629-6419144db236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:47.962485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 311/633] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:47.963584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3b5d-63a0-4df1-a23d-172186f5439e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.038806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976882b-6f9e-468e-a629-6419144db236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.040357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976882b-6f9e-468e-a629-6419144db236 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.107246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.116549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.130326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3b5d-63a0-4df1-a23d-172186f5439e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.157284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 323/634] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:48.158630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.158930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.159211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.179296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.180068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.180351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.180625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.180746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:48.181982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:48.191891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.193333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:48.208176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:48.209148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:48.210073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:48.210073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:48.210073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:48.210073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:48.214507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 312/635] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:48.215408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.256365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 324/636] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:48.257228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.335456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2114a-38f5-47c0-b15b-ad9c966dace9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.383176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.383805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.384641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.385033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.388206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.394197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941639-63aa-47af-8a07-d22655c8801b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.401327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.401327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.406252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:48.414684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:48.415847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:48.417423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:48.417423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:48.417423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:48.417423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:48.417423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 313/637] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:48.417423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.440149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.440778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.441118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.441401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.442103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:48.442711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.443964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54dfb-1616-40fd-aa40-09fa5a0e8d1b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.460933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 325/638] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:48.460933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7dcf-17b1-4d31-82aa-64066abe918a None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.460933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7dcf-17b1-4d31-82aa-64066abe918a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.460933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa7dcf-17b1-4d31-82aa-64066abe918a None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.460933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 326/639] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:48.460933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7dcf-17b1-4d31-82aa-64066abe918a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.537413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8eb0d-9b5f-47b4-8930-bf48cfff1e51 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.571140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa7dcf-17b1-4d31-82aa-64066abe918a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.574755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.575397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.575680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.576000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.587198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:48.593358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:48.594304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:48.595161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 314/640] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:48.596935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.619083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.619923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.620035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.620286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.620992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:48.621303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.622709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36f199-6531-4874-a5d6-eff379d11ba8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.640017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 327/641] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:48.640017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.640017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.640017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.656386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:48.657604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:48.661290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.672390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.709722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa0709-ca5d-49a3-9652-fc5620727401 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.734716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 328/642] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:48.735749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.752990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.754181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.754181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.754660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.770041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.771678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:48.784915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:48.786241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 315/643] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:48.792759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.874670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7b308-fcbb-415e-aa55-68895e2cd74c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.908056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a96f-496b-47f4-811a-ab257026606d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:48.910955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.911586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.911903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.912184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.912909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:48.913215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.914585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.923140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 329/644] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:48.924001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:48.933640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.938278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:48.955723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:48.956503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:48.956788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:48.957069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:48.964102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:48.965534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:48.977461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:48.984188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:48.985230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:48.986220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 316/645] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:48.987440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.034642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02944f-084a-4ede-bb35-3a9c8f7d8a21 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.072731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.073380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.073669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.073948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.084689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:49.090387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:49.091368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 330/646] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:49.093103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.108131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc50db-bd80-4ab2-8340-ed0bac049152 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.156318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.156963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.157245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.157527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.158383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:49.158641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.160122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.168912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.183621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 317/647] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:34:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:49.183621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.213774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be27b58-8da3-483c-a5a3-a6a0d1c142ee None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.229403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.249341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.250077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.250457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.250801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.264370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.265924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:49.281215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:49.282351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:49.283266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:49.283266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:49.283266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:49.283266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:49.283266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 331/648] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:49.283687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.311901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a95ef6-4ff0-415f-9989-ceda63529a29 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.349729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.350333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.350680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.350972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.351718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:49.352064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.354134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.366578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 318/649] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:49.367804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.396669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f7c4f-84f1-4c80-8c5e-3b0f8e98c6cb None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.419986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.434780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.435412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.435981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.435981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.436727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:49.437037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.438431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.447695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 332/650] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:49.448570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.482850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.490357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83700c-2bc6-44c3-aa56-2de38aa144e1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.532341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.532981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.533269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.533548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.561104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f004d90-e15c-44d6-a12d-56b1b245209b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.601144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.601763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.602054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.602333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.603061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:49.603362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.604916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.607249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.608736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.622415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 333/651] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:49.623660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.672392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.712982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.720074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 319/652] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:49.720888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.731237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c679a-cbe4-4702-8a70-4817c3fbce1f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.769023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.769975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.769975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.770192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.770994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=e9a8f7e27170404ebf1a2be70efe63fe) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:49.771309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.772804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.779096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 334/653] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/role_assignments?user.id=e9a8f7e27170404ebf1a2be70efe63fe&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:49.779915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.829460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b381-5c2c-4ccf-94fe-40b7c737ea60 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.868897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.869652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.869906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.870158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.882532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.884573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4cbb395d-ffef-4ae0-a57b-6d7347f8c049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:49.901715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:49.902689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:49.903662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:49.903662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:49.903662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:49.903662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:49.903662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 320/654] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:49.904610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038889-9e43-40bc-863a-37dc61d9bb69 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.904610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038889-9e43-40bc-863a-37dc61d9bb69 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.904883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038889-9e43-40bc-863a-37dc61d9bb69 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.906372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 321/655] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:49.907010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7038889-9e43-40bc-863a-37dc61d9bb69 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:49.912650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6fe0-461b-44c5-b068-63daf1425207 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:49.925026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.957681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:49.958339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:49.958627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:49.958998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:49.975979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:49.977583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:49.979673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:49.993324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:49.995548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 335/656] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:49.997840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.056971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7038889-9e43-40bc-863a-37dc61d9bb69 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.102476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.103540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.104014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.104467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.116036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.117522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.126505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a323-991e-4944-b1cb-ef53e4493952 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8ee07465-6580-438d-983f-90c36c16738f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:50.134460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:50.135508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:50.136990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:50.136990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:50.136990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:50.136990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:50.136990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 322/657] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:50.143908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.143908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.143908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.162357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.162874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:50.162984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.163256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.163536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.164127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:50.164304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:50.164578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.166075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.184855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 336/658] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:50.184855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.214817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.253498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 323/659] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:50.254952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.295847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.312074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60e141-6c3e-4c8b-9b2e-544965862716 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.348985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.349610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.349893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.350170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.350973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:50.351283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.352873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.372030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 337/660] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:50.372030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.389053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1469db-aa3d-40b0-9dda-107dc8bdb920 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.424815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.425454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.425736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.426095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.426697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:50.426993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.428547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.440210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 324/661] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:50.445139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.470163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.487334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374578c-9e04-4868-9fe5-2640c09b3191 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.525806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.526449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.526758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.527035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.534429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.536170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.548220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:50.548707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:50.549690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 338/662] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:50.550648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.563826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9b4c-5909-439c-8f46-a420f9e17409 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.602507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a976002-77b9-434d-9267-684417ece940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.603598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976002-77b9-434d-9267-684417ece940 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.603975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976002-77b9-434d-9267-684417ece940 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.604258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a976002-77b9-434d-9267-684417ece940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.616330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a976002-77b9-434d-9267-684417ece940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6a976002-77b9-434d-9267-684417ece940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:50.623230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:50.624303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:50.625161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 325/663] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:50.625874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a976002-77b9-434d-9267-684417ece940 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.666331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aa67-c7ea-473c-9102-fe7a655568ca None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.701330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.701871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.702159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.702438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.717020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.734807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a976002-77b9-434d-9267-684417ece940 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.773033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.773678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.773963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.774240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.774355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.776590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.782205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.783643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:50.796447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:50.797395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:50.798278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 326/664] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:50.798806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.815086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.890145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 339/665] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:50.891411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:50.915410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c4680-dcab-4be9-bc50-ed7753776600 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:50.945890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:50.956913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:50.956913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:50.956913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:50.956913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:50.957328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:50.957328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:50.957328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:50.976502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 327/666] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:50.977366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.013383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf87f-41fa-4e67-9597-535b81527c37 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.059014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.061493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.062138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.062419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.062691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.063435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:51.063814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.065212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.078899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 340/667] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:51.078899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.104465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4192d8-169b-4a4f-b509-2f41fa915b90 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.141321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.142032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.142329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.142607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.143365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:51.143710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.145178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.158053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 328/668] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:51.159324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.186576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3f68-a691-4f65-9ae2-addba7545645 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.194135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.225994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.226766 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.227052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.227346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.240505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.241984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:51.256874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:51.257787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:51.258743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:51.258743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:51.258743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:51.258743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:51.258743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 341/669] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:51.259703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.298247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2fad4-7f12-4a04-bde6-5dc7b23c31ff None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.330118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.341354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.342039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.342343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.342755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.388516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4585a-d44e-44ed-9806-e8f10095f698 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.417133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.418596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.423615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.424296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.424584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.424862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.437900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.439349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:51.455179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:51.456130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:51.457043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:51.457043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:51.457043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:51.457043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:51.457043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 342/670] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:51.457317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.472858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.538479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 329/671] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:51.539732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.568045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c5aa-2afb-431a-ad03-782943c8fabc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.574376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.605239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.605864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.606175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.606496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.607360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=f27a1a3e92fa4293a57b8b4024d065b5) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:51.607681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.609143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.624152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 343/672] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/role_assignments?user.id=f27a1a3e92fa4293a57b8b4024d065b5&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:51.624152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.667447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804522-8ca4-4ef0-8544-6348f9c479a5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.713811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.714450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.714732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.715010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.715718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:51.716058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.717766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.725194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.738185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 330/673] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:51.739752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.765981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f88de-5011-4cad-b6d7-8dc9f9da93f2 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.817728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.818561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.818851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.819385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.820456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:51.821042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.823055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.838457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 344/674] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:51.839336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.854882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:51.870719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197156-3c4f-4974-9e43-ad6c716588f6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:51.914092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:51.914741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:51.915026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:51.915395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:51.932121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:51.933749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:51.954022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:51.954963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:51.955899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:51.955899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:51.955899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:51.955899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:51.955899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 331/675] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:51.956199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:51.968876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251de7-0208-4c8a-8503-4ef54006f85a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.008819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.009996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.010295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.011124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.012939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.018575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.020087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:52.033110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:52.040860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 345/676] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:52.042066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.093886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70077a50-b0bd-484b-ba66-9a281f122eea None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.131714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.132390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.132672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.132945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] PATH_INFO: `/v3/users/swift` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.141355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.142803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.145689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.150131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27d71-5a86-447e-b50c-d03c270c5453 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c070581c-2804-4879-9155-a2c4c49665da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:52.156141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:52.162422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 332/677] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17381d-78bf-466c-b1e1-aeb751337190 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.163354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17381d-78bf-466c-b1e1-aeb751337190 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.164118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17381d-78bf-466c-b1e1-aeb751337190 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.164118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 333/678] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:52.164118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17381d-78bf-466c-b1e1-aeb751337190 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.195775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.196510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.196936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.197345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.198055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:52.198367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.199742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.212704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 346/679] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:52.213626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.272482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.289925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17381d-78bf-466c-b1e1-aeb751337190 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.326884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.327505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.327814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.328095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.328740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3060b6-2cfe-41e6-9638-10a1648a80af None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.328850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:52.329149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.330590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457acc7-0deb-47ab-9f63-35f00432bde9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.344894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 334/680] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:52.346127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.346421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.346696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.364994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:52.366189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:52.370577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.371228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.371490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.371786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.376183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:52.376183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.376183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.395482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 347/681] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:52.396390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.433927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.455799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 335/682] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:52.455799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.502244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d4ea2-240f-4388-bae1-61f725a3d1dc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.517191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.538896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.539541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.539920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.540228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.547213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.548702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:52.561051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:52.562971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:52.567145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 348/683] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:52.568034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.575030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98050e-c96e-4e39-a4eb-8e0cef49a99a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.612593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.613220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.613782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.613782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.614577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=4957fb8ec82d40f985b586cda019a0ab) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:52.614891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.616445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.623235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 336/684] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/role_assignments?user.id=4957fb8ec82d40f985b586cda019a0ab&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:52.623983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.699088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff36d4-e644-4864-b910-1525a8adc607 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.700292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.740171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.741262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.741262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.741475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.772549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eba97-67de-4c87-9d19-1b6d3a839d40 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:52.793013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:52.827519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:52.828715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:52.828715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:52.828886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:52.833459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.834924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.842415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:52.843926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:52.866423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:52.867352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:52.869305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:52.869305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:52.869305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:52.869305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:52.871866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 337/685] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:52.872875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.963943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 349/686] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:52.964836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:52.995444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e577a8-b7c6-4c65-9718-9eefa0cdb1b5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.003173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:53.031981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.033092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.033743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.034126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.034999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:53.035800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.038017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.045887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:53.059363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 338/687] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:53.060491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:53.085864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c84d5-999c-45d6-95a9-6527159d0f87 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.125092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.126310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.126742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.127179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.128069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:53.128526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.130845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.148206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 350/688] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:53.148964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:53.194744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79c471-3a54-443d-a0ae-0e58a982241f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.241545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.242544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.243045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.243670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.255541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.257516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:53.273453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:53.274853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:53.275750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:53.275750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:53.275750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:53.275750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:53.276523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092334-3a04-4ca9-b173-8f41f8262249 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.278152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 339/689] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:53.279250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:53.305189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:53.310135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:53.320590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.321257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.321541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.321816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.322623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=d361924fd6fc4cf2891d60fcad455a44) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:53.322934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.324451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.337428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 351/690] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:53 2022] GET /identity/v3/role_assignments?user.id=d361924fd6fc4cf2891d60fcad455a44&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:53.337903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:53.410477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaeb38-7fd5-4adb-a1d5-6c05ea222810 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.450325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.451445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.451986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.454098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.455102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.456881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.516006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981bae4-4b4e-4917-b6e5-3070afd8c05c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.557350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.558363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.558924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.559490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.560460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:53.561230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.563092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.578061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 352/691] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:53.583338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:53.592779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 340/692] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:34:53 2022] POST /identity/v3/users => generated 254 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:53.667463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:53.720840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d8d7-c9fc-4f50-a483-50138a896e9b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.761374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.762047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.762335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.762613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.770217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.771683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:53.784798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:53.785984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:53.786863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 353/693] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:53.793396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:53.891193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:53.922870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d3021-ed57-4b6e-89d7-eaedf4ab830c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:53.969712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:53.970390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:53.970680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:53.970959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:53.971721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:53.972056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:53.973576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55129a27-da3d-4cdf-84fc-127884d15635 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:53.998010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 341/694] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:54.004305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:54.016380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53befd0c-eb44-4cee-9edb-f3561891ce27 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.016895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53befd0c-eb44-4cee-9edb-f3561891ce27 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.017069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53befd0c-eb44-4cee-9edb-f3561891ce27 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.018793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 342/695] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:54.030161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.030474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.030779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.068888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:54.070509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:54.150250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbf54-8804-48a2-b570-65a457ccdfda None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:54.169399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:54.190700 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:54.191711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.192032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.192310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.193397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=702abbf0ba844ec99db46a7b0c54b288) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:54.193932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:54.196318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:54.204170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 354/696] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:54 2022] GET /identity/v3/role_assignments?user.id=702abbf0ba844ec99db46a7b0c54b288&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:54.266633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 343/697] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:54.324789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:54.444342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe892-5e5b-489e-bb93-7adce765a760 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:54.486502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:54.487215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.487549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.487797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.502045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:54.508035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:54.509501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:54.510345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:54.513147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 355/698] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:54.518636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:54.591429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:54.634572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132b7be-511c-4be9-9cd9-09e9e3dc3fd2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:54.677059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:54.677691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.677971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.678245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.678967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:54.679271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:54.681311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:54.692049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 344/699] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:54.697822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:54.754078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:54.816715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81334a82-a259-400c-b81b-429f55f2a7d1 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:54.860258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:54.860909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.861195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.861475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.886055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:54.887532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-bef82d12-d2b1-4850-9158-323be8afb1c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:54.908236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:54.909171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:54.910073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:54.910073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:54.910073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:54.910073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:54.910073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 356/700] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:54.917388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:54.990101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f565b61-7da8-45c5-8f31-d6f15ac7755f None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:54.990406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f565b61-7da8-45c5-8f31-d6f15ac7755f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:54.990573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f565b61-7da8-45c5-8f31-d6f15ac7755f None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:54.996899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 357/701] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:55.002753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:55.003040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:55.003327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:55.037121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:55.040921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:55.091613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc0fd3-22f9-457f-a993-bb6111494124 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.124788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 358/702] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:55.148542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:55.154296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:55.169688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:55.171498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:55.172967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:55.173460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:55.175447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:55.177373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:55.180608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:55.197388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:55.210306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 345/703] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:55.216768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:55.357236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a4c4c-e4e1-4fba-a10c-aff7e2ea8b07 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.428906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:55.429604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:55.429893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:55.430174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:55.431410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:55.432918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:55.433278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c777-d1ca-4863-a43b-191d5faed0bc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:55.444573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:55.445682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:55.447240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 359/704] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jul 25 22:34:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:34:55.455780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:55.517838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:55.518875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:55.519378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:55.519906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:55.528432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:55.530139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:55.545171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:55.546115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:34:55.547026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:55.550451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 346/705] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:34:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:55.556640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:55.581158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:55.612307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:55.615111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29076e-0a86-44f2-a2ef-89a80032aca3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.677447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c2d9-89c7-4b09-8b52-b3b189ae9785 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.701489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:55.702136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:55.702430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:55.702710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:55.703408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:55.703719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:55.705134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:55.717477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:55.718438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:55.718991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:55.719098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 360/706] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 25 22:34:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:55.719653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:55.720756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:55.721309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:55.723057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:55.724169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:55.749939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 347/707] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:34:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:55.756097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:55.936838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db1c8-605d-49e4-bb0b-155c690f91d2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.953584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd6ae1-a4d5-4a60-b6fc-50ecb388ff29 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:55.960165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.012054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7378dcb-e07d-4f1d-bfe9-9a2d254bd1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.012662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378dcb-e07d-4f1d-bfe9-9a2d254bd1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.012951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378dcb-e07d-4f1d-bfe9-9a2d254bd1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.013231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378dcb-e07d-4f1d-bfe9-9a2d254bd1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.021769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.022399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.022678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.022949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.023652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:56.023982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:56.025720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3815b-170d-43e4-b227-b8dc5c01833c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:56.035938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 361/708] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 25 22:34:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:56.083110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca22a-c9b9-4680-b83d-753ed5acdc11 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.083786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca22a-c9b9-4680-b83d-753ed5acdc11 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.083786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ca22a-c9b9-4680-b83d-753ed5acdc11 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.085365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 362/709] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:34:56.107658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9272d-9f12-42e1-bc1e-2310becb984d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.107957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9272d-9f12-42e1-bc1e-2310becb984d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.108248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9272d-9f12-42e1-bc1e-2310becb984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.116099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7378dcb-e07d-4f1d-bfe9-9a2d254bd1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:56.118794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7378dcb-e07d-4f1d-bfe9-9a2d254bd1f3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:56.152044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-83a9272d-9f12-42e1-bc1e-2310becb984d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:56.153181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-83a9272d-9f12-42e1-bc1e-2310becb984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:56.174591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.250899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 348/710] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:56.253327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608543-a271-490c-b408-1b55ca35513f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.253671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608543-a271-490c-b408-1b55ca35513f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.253913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608543-a271-490c-b408-1b55ca35513f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.255471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 349/711] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:56.260990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff608543-a271-490c-b408-1b55ca35513f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.267773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.279453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 363/712] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:56.284343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.284644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.284932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.311649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:56.312898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:56.387434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 364/713] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:56.388377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.414705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff608543-a271-490c-b408-1b55ca35513f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:56.459353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.460056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.460347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.460629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.473673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:56.475221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:56.494083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:56.495145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:56.496061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:56.496061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:56.496061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:56.496061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:56.496061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 350/714] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:56.496778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.564741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.616414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.625217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b646-b3a0-435d-93c4-a166ec22bd77 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:56.643273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee94f6-9f42-4bfa-81a2-4dd16db7fc16 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:56.673372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.674422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.674718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.675001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] PATH_INFO: `/v3/services/network` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.675942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:56.677589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:56.683985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.684936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.685422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.685894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:56.692087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:56.693136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:56.693967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 351/715] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:56.695242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.702158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:56.707568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:56.708532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:34:56.709382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:56.712692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 365/716] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:56.713844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.825433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890042f-cda2-4f0b-aaf4-94ad1e7104fc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:56.841764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a9366-2fa7-4442-8ea7-82ff20802503 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:56.846858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.862375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.863004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.863348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.863630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.864379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:56.864739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:56.866120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:56.884403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 352/717] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:56.884403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.885597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:56.886238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.886524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.886802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.887503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] RBAC: Adding query filter params (name=network) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:56.887839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:56.889224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891131-8b29-420e-b019-d4970a6af328 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:56.890615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:56.899475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 366/718] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:56.900929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801504f-826a-4f72-a8cf-27deb9177e98 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:56.901467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801504f-826a-4f72-a8cf-27deb9177e98 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:56.901577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801504f-826a-4f72-a8cf-27deb9177e98 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:56.907070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 367/719] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:56.907956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801504f-826a-4f72-a8cf-27deb9177e98 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:56.992352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caf2ee-d183-4262-86b6-f25f4f6815fa None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.018746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801504f-826a-4f72-a8cf-27deb9177e98 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.037869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.038511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.038802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.039083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.040509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:57.040931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.042834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.052935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 353/720] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:57.053865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.059845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.060687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.060975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.061253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.069492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.072121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-7f99ca1e-3441-4938-8495-60d747afb75b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:57.084461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:57.085940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:57.087880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:57.090902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 368/721] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:57.092167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.092458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.092736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.106973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:57.111303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:57.112535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:57.170249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f08968-2573-47f5-8e38-c86cf5427a2e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.170964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:57.195783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 369/722] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:57.195783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.223532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.224268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.224552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.224835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.225525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] RBAC: Adding query filter params (type=network) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:57.225835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.227249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.235273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 354/723] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:57.235273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.316149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050a637-0545-4815-9dd0-6eeb0ba9e122 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.371743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.372717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.373006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.373282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.381274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290bd3-9817-46c5-9fc6-6c2c87096b71 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.388403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.389875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.392642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:57.409929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:57.414579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:57.415532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:57.415532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:57.415532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:57.415532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:57.415532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 370/724] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:57.415532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.435078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.435714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.436060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.436341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.437105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:57.437420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.438886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.454630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 355/725] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:57.455307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.466353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:57.535799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1b0b-2a27-4ac9-b23b-b6d86c19c70e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.571984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.572702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.573003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.573250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.583051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe2239-0be6-4dda-95fd-ba9acd09125a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.588538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:34:57.594039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:57.595101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:57.596369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 371/726] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:57.597089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.632335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.634084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.635501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.636034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.636964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:57.637488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.639051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.659609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 356/727] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:57.659609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.691234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:57.728685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:57.732615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6b68e-583f-47b5-8a31-32a974342737 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.769281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.770357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.770866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.771372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.772532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=f27a1a3e92fa4293a57b8b4024d065b5) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:57.773138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.775321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.776717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a5b06-54d0-4353-8561-119c180c0c22 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.782438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 372/728] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/role_assignments?user.id=f27a1a3e92fa4293a57b8b4024d065b5&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:57.784446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.823312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:57.823988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:57.824278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:57.824721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:57.825557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:57.825875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:57.827268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:57.839785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 357/729] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:57.847800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:57.972610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcf23-ba78-4e40-b10b-ed0957588787 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:57.995167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.008455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f33cb-15a8-4646-ab47-2c7905f9bb13 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.016483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.017464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.018011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.018497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.027330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.029392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:58.044978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:58.045989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:34:58.046967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:58.048718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b680629-e522-447f-844a-d614a394c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.049538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b680629-e522-447f-844a-d614a394c22d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.049743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 373/730] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:58.049881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b680629-e522-447f-844a-d614a394c22d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.050322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b680629-e522-447f-844a-d614a394c22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.054920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.070861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b680629-e522-447f-844a-d614a394c22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.073270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b680629-e522-447f-844a-d614a394c22d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.084105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1b680629-e522-447f-844a-d614a394c22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:58.096472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:58.097720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:58.098600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:58.098600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:58.098600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:58.098600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:58.098600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 358/731] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:58.103104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b680629-e522-447f-844a-d614a394c22d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.170343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179206-2cf4-4275-8c05-debcc1ba4726 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.240177 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.240774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.241066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.241347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.242172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:58.242485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.244254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca06d4-1d28-4458-baf2-8c698541b551 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.263693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 374/732] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:58.265082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf1992-6356-481e-a95e-cf655945dfa8 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.265380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf1992-6356-481e-a95e-cf655945dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.265661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf1992-6356-481e-a95e-cf655945dfa8 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.267207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 375/733] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:58.271900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf1992-6356-481e-a95e-cf655945dfa8 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.273019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b680629-e522-447f-844a-d614a394c22d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.327940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.329261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.329753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.330775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.331988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:58.332815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.334810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e067a-70f3-431b-9d95-636aedccd85d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.348389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.355841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 359/734] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:58.357150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.357443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.357726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.371486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.385099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:58.387334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:58.393777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf1992-6356-481e-a95e-cf655945dfa8 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.436141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.436651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.436938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.437218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.465384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 360/735] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:58.466559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.532737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.534215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.572264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ed534-6d58-467a-9a3a-f0c33503ecef None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.603733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.610020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.617294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.617294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.617294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.620315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.621869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:34:58.635071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:58.636119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:34:58.637051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:34:58.637578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.637661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 361/736] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:58.643294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.649601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 376/737] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:58.657423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.749344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204119-38ab-4f6e-8620-13c28e7c11d9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.760788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4868-435e-49b8-908e-4a93ee96c2c0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:58.784202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.784752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.785292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.785608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.786278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.787644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.797665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:58.798289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:58.798578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:58.798858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:58.799673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:58.800025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:58.801587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:58.819940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 377/738] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:58.820889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.867453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:58.912266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 362/739] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:34:58 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:34:58.914412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:58.952149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1908-1345-4cec-8c7e-6e13d3ec5006 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:59.037656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:59.045266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:59.046190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.046632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.047059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.060702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:59.062625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:59.082126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:59.083378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:59.084318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:59.084318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:59.084318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:59.084318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:59.087297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 378/740] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:59.095851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:59.154526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c36b-befc-47f1-906b-fa3bba7201c5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:59.196484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:59.197074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.197363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.197642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.243113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:59.265161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96edf-9da4-459e-87de-10ca2df86cb9 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:59.292597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:59.299811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:59.347741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:59.348459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.348748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.349027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.349751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:59.350061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:59.353845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:59.372723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 379/741] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:34:59.380528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:59.400963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:59.582996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb085-4269-4fbd-8aba-17a10a850726 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:59.622411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:59.623091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.623361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.623642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.632573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:59.634874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-911f09a8-c99c-4d69-8cd6-321abd77b33c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:34:59.646882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:59.647887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:59.649750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 380/742] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:59.650672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ed58-d246-418c-bc00-d6c8c53c72ed None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.650672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ed58-d246-418c-bc00-d6c8c53c72ed None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.650819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ed58-d246-418c-bc00-d6c8c53c72ed None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.652723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 363/743] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:34:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:34:59.655641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:59.656827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 381/744] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:34:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:34:59.657730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4ed58-d246-418c-bc00-d6c8c53c72ed None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:59.673528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:59.790126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4ed58-d246-418c-bc00-d6c8c53c72ed None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:59.804106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ac4fc-7677-4ce9-944d-9d37c865843e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:34:59.828710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:59.829896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.829896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.830252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.841963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:59.843505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:59.846104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:34:59.847013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.847441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.847892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.848792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:34:59.849264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:34:59.850824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-c30c4f6c-bcb4-4714-99ce-589f2d6b95ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:34:59.860719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:34:59.861641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:34:59.862686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:34:59.862686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:34:59.862686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:34:59.862686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:34:59.862686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 382/745] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:34:59.864198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:34:59.864548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:34:59.864900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:34:59.868665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 364/746] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:34:59.869902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:34:59.882891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:59.884849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:34:59.886100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:34:59.951995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:34:59.967831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 383/747] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:34:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:34:59.969005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.013590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d40f-d4a8-4d5f-a669-b08ce5dba6bc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.057607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.058411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.058613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.058896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.059604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:00.059943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.061388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.077379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 365/748] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:00.078235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.103034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b01dcd-dbcf-4ab4-bc55-d8c27e1a4003 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.140876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.141813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.142283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.142567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.143372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=84424cb942bb42afbd8f2b4b7d704e5c) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:00.143689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.145151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.151548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 384/749] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:34:59 2022] GET /identity/v3/role_assignments?user.id=84424cb942bb42afbd8f2b4b7d704e5c&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:00.152444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.166551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:00.207084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ed583-772d-4bda-a622-156bd6b2f57b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.226300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:00.251929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee25429-67d9-4020-8d40-22ac4dd2e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.252709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25429-67d9-4020-8d40-22ac4dd2e99d None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.253072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25429-67d9-4020-8d40-22ac4dd2e99d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.253426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25429-67d9-4020-8d40-22ac4dd2e99d None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.254233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee25429-67d9-4020-8d40-22ac4dd2e99d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.256324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee25429-67d9-4020-8d40-22ac4dd2e99d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.288488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c342-96dc-46bd-885f-a8a1fd784c4f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.333861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.334521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.334811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.335189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.344158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 366/750] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:00 2022] POST /identity/v3/services => generated 240 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:00.345463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafdfbe-f819-4707-9fdd-323a69b0433b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.345760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafdfbe-f819-4707-9fdd-323a69b0433b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.346048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafdfbe-f819-4707-9fdd-323a69b0433b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.347421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 367/751] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:00.349753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.351263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.355317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.355584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.355831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:00.367969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:00.369059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:00.369945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 385/752] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:00.375149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.376597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:00.378075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:00.461605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 368/753] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:00.516826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4fc0b-b2c4-4c1c-98f3-f18ee66f4840 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.528871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.543085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:00.557450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.558082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.558439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.558719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.559644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:00.560013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.561525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.575701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 386/754] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:00.581208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.596395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:00.646803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c03f36-a848-4744-a3eb-b45679121987 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.692522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.693179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.694180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.694470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.703016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11108a5-2865-4665-b025-20a77aa5a18f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.705766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:00.710699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:00.712478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:00.713309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 369/755] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:00.719938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.747264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.747931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.748272 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.749153 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.749976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=702abbf0ba844ec99db46a7b0c54b288) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:00.750629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.752912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.762412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 387/756] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:00 2022] GET /identity/v3/role_assignments?user.id=702abbf0ba844ec99db46a7b0c54b288&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:00.844451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b0347-0b7e-4536-a40b-b6573f0233b0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:00.862891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:00.882611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:00.883276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:00.883566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:00.883876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:00.884694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:00.885006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:00.886425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:00.897058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 370/757] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:00.908977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:00.984586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:01.067664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9befbf-cd80-4e68-b84e-48c3b2ea0efd None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:01.116463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:01.117367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.118078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.118529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.130433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:01.132155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:01.151289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:01.152424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:01.153381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:01.153381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:01.153381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:01.153381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:01.153381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 388/758] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:01.159441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:01.327880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb922-9752-4124-9ff3-f8505188ee59 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:01.374056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:01.375009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.375469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.375943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.376813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:01.377318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:01.378851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a778a-bb6c-426d-bd7f-b196096d87cc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:01.391242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 371/759] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:01.396944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:01.482415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c2078-9a00-466f-b68e-b8ce08f67373 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.482616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c2078-9a00-466f-b68e-b8ce08f67373 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.483021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c2078-9a00-466f-b68e-b8ce08f67373 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.484834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 372/760] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:01.490232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.490628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.490998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.511087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:01.512467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:01.548477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:01.554737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:01.561162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e66a-f124-4bfc-8f2a-4157aeb86bb5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:01.599887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 373/761] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:01.618729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:01.626448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:01.627108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.627395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.627672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.640992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:01.642467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:01.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:01.668836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:01.669756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 389/762] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:35:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:01.676490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:01.725183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24749b9-4d48-4e91-b327-947b31912573 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:01.763436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:01.764106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.764395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.764674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.766147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:01.767546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:01.777383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:01.778339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:35:01.779150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:01.783963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 374/763] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jul 25 22:35:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:01.785406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:01.832145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:01.901074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93970c25-d8c2-4e07-9e5a-52024e8b59e4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:01.937660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537832-b193-4cae-8d62-26dac9995939 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:01.939703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:01.940412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:01.940706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:01.940994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:01.942521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:01.942843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:01.944252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:01.954394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 375/764] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 25 22:35:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:01.959776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.028197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.029342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.029839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.030409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.031501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:02.032088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:02.033910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:02.073584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 390/765] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:35:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:02.078346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248e81-d9f1-46dd-905b-1260732be20f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.078346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:02.079858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.103115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:02.120483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.121144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.121435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.121716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.122469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:02.123328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:02.126778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:02.138738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 376/766] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 25 22:35:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:02.138738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.282365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d1b69-7f31-483c-9508-7a880c1ee103 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.331648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.332469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.332769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.333043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.333842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] RBAC: Adding query filter params (interface=public, service_id=f8bd981301ca4745973a8e55600313aa, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:02.334157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:02.335560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db30e3-5a19-4718-99e9-b4ad5344d7ed None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.335740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:02.355812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 377/767] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/endpoints?service_id=f8bd981301ca4745973a8e55600313aa&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:02.355812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.410672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:02.426519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.427259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.427454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.427726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.448590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:02.450175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:02.474838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:02.475816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:02.476710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:02.476710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:02.476710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:02.476710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:02.480224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 391/768] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:02.484617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.521417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5482a-7303-4241-8260-e8c1faf5eb6b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.577903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:02.593962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b342c-af22-47d5-83f0-0676db5625cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.595039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b342c-af22-47d5-83f0-0676db5625cb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.595526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b342c-af22-47d5-83f0-0676db5625cb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.596682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b342c-af22-47d5-83f0-0676db5625cb None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.597624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b342c-af22-47d5-83f0-0676db5625cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:02.599636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b342c-af22-47d5-83f0-0676db5625cb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:02.608275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 378/769] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:02.609876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0be75e-0366-4e47-83cb-a041692fb032 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.610326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0be75e-0366-4e47-83cb-a041692fb032 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.610750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0be75e-0366-4e47-83cb-a041692fb032 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.616726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 379/770] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:02.619404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.619955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.620387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.644390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:02.646210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:02.654920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344850e-f7ac-4d99-8c69-3c46d6226cbb None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.741213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 380/771] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:02.766325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.766609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.766973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.767263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.767546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.768307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:02.768626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:02.770047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:02.791650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:02.798231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 392/772] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:02.804532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.905420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98c46c-8388-44bd-8b2f-3449af4df1c8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.946537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940bc7e-2fe5-4997-8191-586cb0d6f42d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:02.949073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.950324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.950324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.950500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:02.963348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:02.968806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:02.969739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:35:02.970599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:02.975305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:02.975529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 381/773] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:02.978414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:02.994792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:02.995869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:02.996275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:02.996656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.006789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.009658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:03.028056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:03.029253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:03.030389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:03.031354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 393/774] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:03.037297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.080436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:03.106074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a38a1-53a9-40d7-ab09-40f3e4188cd8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.146578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.147497 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.147881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f289-e738-482b-b9ea-f970b172712b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.148181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.148629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.149727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:03.150301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.151982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c2fde-cb2e-41d0-94ef-8cd1954d6548 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.166263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 382/775] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:35:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:03.167934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a975d-ca10-4dc4-bc00-870bea2b5284 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.168422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a975d-ca10-4dc4-bc00-870bea2b5284 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.169031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a975d-ca10-4dc4-bc00-870bea2b5284 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.174629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 383/776] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:03.176707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.177229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.177707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.184337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.184966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.185253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.185533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.186536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:03.186859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.188345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.200744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:03.201885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 394/777] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:03.202746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.202856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:03.251081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:03.283888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 384/778] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:03.285693 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.324815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ffab-79cc-4cee-becc-e7460bf4c662 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.367209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.368827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.369116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.369396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.380100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:03.387528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.389420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:03.409531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:03.411123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:03.412071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:03.412071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:03.412071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:03.412071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:03.412071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 395/779] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:03.412365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.416615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f5523-e371-4bdb-92e9-0e957667a79e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.453855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.454684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.455025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.455306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/f27a1a3e92fa4293a57b8b4024d065b5/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.458112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=f27a1a3e92fa4293a57b8b4024d065b5, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.459550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.511198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:03.519586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d3fc-4a73-42c1-bceb-d1dd83f4ee23 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.543809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 385/780] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:03 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/f27a1a3e92fa4293a57b8b4024d065b5/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:03.543809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.568570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.569711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.569999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.570275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] PATH_INFO: `/v3/services/network` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.571244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.572917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-8b9fc635-cb48-4361-90dd-3c5b05665796 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:03.583368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:03.584477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:03.585322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 396/781] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:03.586518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0eea5-9dcb-45bf-81e0-4a6ddae803f6 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.586518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0eea5-9dcb-45bf-81e0-4a6ddae803f6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.586660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0eea5-9dcb-45bf-81e0-4a6ddae803f6 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.588215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 397/782] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:03.590830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0eea5-9dcb-45bf-81e0-4a6ddae803f6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.679175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ad861-c7d3-4415-b955-c34e240793ad None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.710630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0eea5-9dcb-45bf-81e0-4a6ddae803f6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.715183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:03.721422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.722248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.722543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.727976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.727976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:03.727976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.727976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b3804-c8f6-4763-9aa8-60081d99df48 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.744310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 386/783] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:03.747428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575098-288e-402a-adec-355fb50bc485 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.747821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575098-288e-402a-adec-355fb50bc485 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.748052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575098-288e-402a-adec-355fb50bc485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.752099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.753544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.753918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.754109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.754800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:03.755106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.757172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.763403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 398/784] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:03.764281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.773273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-83575098-288e-402a-adec-355fb50bc485 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:03.775601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-83575098-288e-402a-adec-355fb50bc485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:03.795792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:03.872146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 387/785] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:03.875982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575098-288e-402a-adec-355fb50bc485 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:03.908317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad7a21-4842-468d-b0c9-8faa33deb9e8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:03.946862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:03.947824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:03.948291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:03.948766 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:03.957546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:03.959212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:03.972288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:03.973270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:03.974322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:03.981071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 399/786] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:03.982186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.028647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575098-288e-402a-adec-355fb50bc485 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.060640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:04.076777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.077688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.078124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.078550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.079383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] RBAC: Adding query filter params (type=network) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:04.079883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.081436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.084698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:04.093199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 388/787] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:04.094573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.113536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b003-e539-42a3-bf55-f8ad6917d3f9 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.153524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.154443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.154885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.155307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.167415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:04.173462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:04.174417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:04.175271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:04.183122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 400/788] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:04.184266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.226787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f862-6066-4bdd-ac7e-3ae8c1487f89 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.264578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.265554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.266042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.266540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.267541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:04.268253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.269960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.295679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 389/789] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:04.297815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.314820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768579-0d50-4fa0-9c2e-d4db20ecc8cd None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.353399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.354432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.354922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.355449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.356477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] RBAC: Adding query filter params (interface=public, service_id=101fc4fe89f44a2d8adc384c8824eaaa, region_id=RegionOne) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:04.357018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.358541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:04.358863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.369734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 401/790] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/endpoints?service_id=101fc4fe89f44a2d8adc384c8824eaaa&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:04.371103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.376422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:04.443730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792854b3-e1f8-474e-80a7-beea48a03aac None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.481943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.482578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.482996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.483709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.484237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:04.484611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.486058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.498008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941971e-e8f2-4aa0-8b06-b028698873ff None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.499886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 390/791] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:04.500778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.543430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.544827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.545340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.546224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.559947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.562143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:04.581555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:04.582503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:04.583379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:04.583379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:04.583379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:04.583379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:04.585610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 402/792] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:04.587580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.628550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c631e52-d7d0-4915-aba0-36ca2fe9507c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.631890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:04.663866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:04.674674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.675530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.675997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.676588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.677889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.679785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.699800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 391/793] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:04.699800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.746298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de2d0-afc3-4d6a-8cb7-458e1de6d634 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.815210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.815907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.816198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.816479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.839474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.841050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:04.871313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:04.872288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:04.873619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:04.873619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:04.873619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:04.873619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:04.873619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 403/794] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:04.882719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:04.922163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59c75-7c32-4247-9b76-8df83ac95e48 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:04.968821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:04.969479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.970190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.970475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.971181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:04.971490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:04.972961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696a9e-319a-4acc-9ec2-cb3968a2f0b3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:04.991403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 392/795] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:04.993949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25f7d4-a111-40d0-a283-0575bc33856c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:04.993949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25f7d4-a111-40d0-a283-0575bc33856c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:04.993949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25f7d4-a111-40d0-a283-0575bc33856c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:04.995295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 393/796] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:04.996035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25f7d4-a111-40d0-a283-0575bc33856c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.028547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.036105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e5908-0233-4a3c-a65b-9f079c149e23 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.050426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.086213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.087275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.087791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.088081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.088795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:05.089107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.091494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c771a-c80e-47d3-bba5-0a5011a8d0f4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.111963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 404/797] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:05.113665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.114335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.114847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.130504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25f7d4-a111-40d0-a283-0575bc33856c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.135636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:05.137138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:05.179684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.180996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.181355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.181748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.191460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.193582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:05.211636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:05.212906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:05.213845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:05.215840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 394/798] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:05.216904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.231901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 405/799] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:05.233171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.340213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.348339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11b126-4635-439c-8ccc-0fd4906cce37 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.365296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.372164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625e81-f1fb-4df7-885d-449ecdf93b87 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.387977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.388441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.388877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.389217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.397460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.398959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:05.414972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:05.416251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:35:05.417207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:05.420943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 395/800] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:05.421836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.434647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.435085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.435377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.435658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.436522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:05.436938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.438430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.457506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 406/801] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:05.458550 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.548861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da0491-99b3-4ff7-be92-fd3188d89e23 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.579556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505296f-0a64-44c7-a2b5-2dd8ba7055d4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.596670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.597792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.598286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.599048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.599928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.601997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:05.614201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:05.615157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:35:05.616019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:05.617656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.618344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.618663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.618944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.623804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:05.623804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.623804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.624349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 396/802] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:05.625781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.650820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 407/803] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:05.651860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.664183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.672135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.755281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a32ca-583c-4af2-80ee-b7e7c8a8618b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.768768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23da951-bf7a-42fc-8f97-3e54f9b43bd0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.791878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe26aa-02b3-48e7-a6c7-70a16daf89ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.792635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe26aa-02b3-48e7-a6c7-70a16daf89ae None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.792998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe26aa-02b3-48e7-a6c7-70a16daf89ae None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.793340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe26aa-02b3-48e7-a6c7-70a16daf89ae None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/84424cb942bb42afbd8f2b4b7d704e5c/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.809346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe26aa-02b3-48e7-a6c7-70a16daf89ae None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=84424cb942bb42afbd8f2b4b7d704e5c, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.809644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.810324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.810613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.810889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.811179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe26aa-02b3-48e7-a6c7-70a16daf89ae None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.811581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:05.811917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.813517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:05.818677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 408/804] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:05.819464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.898610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 397/805] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:05 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/84424cb942bb42afbd8f2b4b7d704e5c/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:05.900052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9d65-be60-486a-9712-919ec1dc154e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.900446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9d65-be60-486a-9712-919ec1dc154e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.900826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9d65-be60-486a-9712-919ec1dc154e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.902370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 398/806] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:05.903029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9d65-be60-486a-9712-919ec1dc154e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:05.912747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:05.941598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f5158-bb9a-451f-b3ef-f579242165f3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:05.983051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:05.983887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:05.984289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:05.984633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:05.997416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:05.999101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.011111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-5910362a-bb3a-4088-b1c5-82d1dc632b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:06.017376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:06.018350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:06.019235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:06.019235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:06.019235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:06.019235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:06.024160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 409/807] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:06.025684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.026052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.026405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.055108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:06.056112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:06.077877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9d65-be60-486a-9712-919ec1dc154e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.126538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.127213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.127505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.127799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.128833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:06.129144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:06.131081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.137895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 399/808] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 25 22:35:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:06.140717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.150977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 410/809] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:06.152159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.235385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:06.279543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6117ef-43ab-47e6-bee4-0fce1b2ec290 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.294930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f669-ef86-43aa-a876-16cafab7171d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.322035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.323224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.323820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.324311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.325278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:06.326905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.329577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:06.341498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.342167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.342459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.342727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.343452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:06.343785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:06.345174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.357552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 400/810] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:06.358331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.473968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 411/811] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:06.473968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.480751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719d21-05ba-4e0e-b0e1-152beb8d7996 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.560488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.561154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.561439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.561715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.587068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:06.592616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:06.593580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:06.594401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 401/812] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:06.609723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.669595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb40c8d-b4cd-4db6-8934-f8463103a46d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.700560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:06.702748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:06.737343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.737998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.738286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.738566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.750183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:06.751652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:06.764937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:06.765883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:06.766761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:06.767627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 412/813] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:06.774935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.795962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d7cff-1b1e-4f8a-9282-ac597fbad8ec None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.847579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.848589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.849326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.849833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.851326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:06.852718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:06.855639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.867574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 402/814] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:06.872781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:06.895630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65d5f-f7f0-43c2-85cc-80d3d8d7a73a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:06.973301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:06.973933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.974212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.974495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.975260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:06.975571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:06.977859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb37ef-1036-43e8-8e64-8fc35246e6eb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:06.991218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 413/815] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:06.993082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcdbd7-12be-4c8c-b76b-4ba46fd39e6d None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:06.993481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcdbd7-12be-4c8c-b76b-4ba46fd39e6d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:06.993854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcdbd7-12be-4c8c-b76b-4ba46fd39e6d None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:06.995355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 414/816] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:07.000027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcdbd7-12be-4c8c-b76b-4ba46fd39e6d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.016011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082239-fee4-457a-b49e-9174a9ed3172 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.019923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:07.047530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:07.065056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.065944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.066377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.066854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.081595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.083062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-15fecbd0-fa91-43f8-bc9a-e2090a697c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:07.106320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:07.107297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:07.108199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:07.108199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:07.108199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:07.108199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:07.108199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 403/817] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:07.109429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.109721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.110003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.132638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcdbd7-12be-4c8c-b76b-4ba46fd39e6d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.133387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:07.134870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:07.179483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.180597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.181767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.182262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/702abbf0ba844ec99db46a7b0c54b288/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.186186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=702abbf0ba844ec99db46a7b0c54b288, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.187629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.215414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 404/818] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:07.219902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.290618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 415/819] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:06 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/702abbf0ba844ec99db46a7b0c54b288/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:07.302926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.316199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:07.335215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4471c-087c-47ac-a3ff-92ba3f83e943 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.375256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.376725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.377207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.377637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.378495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:07.378990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.380562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.394344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 405/820] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:07.403321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.514993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:07.521471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd851c-220d-4896-8bae-055c78c3a0f7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.574535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba974c1-534e-4f7c-8f87-8ddbaf17117d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.583015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.583929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.584377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.585225 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] PATH_INFO: `/v3/services/network` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.586696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.588422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:07.600556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:07.602493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:35:07.603467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:07.607011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 416/821] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:07.614363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.628055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.629021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.629412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.629793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.639374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.641100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:07.654676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:07.655900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:07.657052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:07.663634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 406/822] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:07.666127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.712320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:07.770903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150f47b-6c7e-4cd1-a8b5-00a27fbeddad None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.838070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7ecae-6c2e-452c-a206-d84040e07b25 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:07.843910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.844682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.845883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.851686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.852546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] RBAC: Adding query filter params (name=network) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:07.852865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.854395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.861776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 417/823] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:07.867317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:07.921249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:07.923388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:07.923920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:07.925445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:07.926872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:07.928283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:07.929968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:07.934813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:07.975982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 407/824] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:07.985360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.050937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458cabf-7876-4a08-ae4d-dd57cb93e68e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:08.097484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:08.098539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:08.099173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.099458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.099736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.100463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] RBAC: Adding query filter params (type=network) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:08.100764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:08.102179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:08.114168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 418/825] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:08.124790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.148071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d17df-18bf-4a20-ab27-b1667b53529b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:08.203029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:08.204124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.204581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.205053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.265514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:08.275477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19c6e-dcc6-4dc1-bc47-3c7ba9db2a37 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:08.321136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:08.322880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:08.324704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedb6ce-6e44-42f8-b4a9-6acdee95c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:08.325443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedb6ce-6e44-42f8-b4a9-6acdee95c4c0 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.325923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedb6ce-6e44-42f8-b4a9-6acdee95c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.326304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedb6ce-6e44-42f8-b4a9-6acdee95c4c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.327393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedb6ce-6e44-42f8-b4a9-6acdee95c4c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:08.328671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedb6ce-6e44-42f8-b4a9-6acdee95c4c0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:08.391819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:08.418059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 419/826] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:08.419810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5733b-18a4-490a-a4b2-8e9a95e2c1b2 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.420419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5733b-18a4-490a-a4b2-8e9a95e2c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.421576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5733b-18a4-490a-a4b2-8e9a95e2c1b2 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.425089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 420/827] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:08.436008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9504-de6b-4786-bd81-0607006115fb None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.436884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9504-de6b-4786-bd81-0607006115fb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.437811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9504-de6b-4786-bd81-0607006115fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.461936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 408/828] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:08.462980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.490497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-195a9504-de6b-4786-bd81-0607006115fb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:08.494120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-195a9504-de6b-4786-bd81-0607006115fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:08.624006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a198ec-8de9-4c69-84ea-b27841104494 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:08.627249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 421/829] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:08.652732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a9504-de6b-4786-bd81-0607006115fb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.670567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:08.671262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.671543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.671859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.686926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:08.688444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:08.704785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:08.705755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:08.706633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:08.706633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:08.706633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:08.706633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:08.706633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 409/830] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:08.712147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.735005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:08.761987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:08.803904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a9504-de6b-4786-bd81-0607006115fb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:08.833175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631bb6-239e-4040-bd16-dd070003e5d8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:08.845035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:08.845974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.846445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.846911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.859911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:08.865601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:08.866529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:35:08.868040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:08.870450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 422/831] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:35:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:08.874563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:08.875381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.875892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:08.876388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:08.876925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:08.877908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:08.878458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:08.881450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:08.899049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 410/832] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:08.905590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:08.990061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:08.990300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a945f9-5c8f-48e5-9338-7fdf79ff9347 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.015719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7a84-f07c-41a7-9c0e-6d0f34a7c9ae None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.021028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.027254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.028271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.028591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.028911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.029720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:09.030033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.031748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36018699-18a9-4bb8-add2-6f0b2fc08e10 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.042567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 423/833] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:35:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:09.043820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2775c-e4c7-47e4-82ae-c22530815600 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.044112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2775c-e4c7-47e4-82ae-c22530815600 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.044391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2775c-e4c7-47e4-82ae-c22530815600 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.047823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 424/834] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:09.047823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2775c-e4c7-47e4-82ae-c22530815600 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.063088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.063733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.064069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.064347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.071294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.072784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-0e80e4aa-3190-4367-8286-114139fc54e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:09.085529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:09.087000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:09.087908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 411/835] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:09.088857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.089145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.089422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.108913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:09.110140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:09.163370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2775c-e4c7-47e4-82ae-c22530815600 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.178767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 412/836] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:09.179452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.203494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.204210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.204494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.204877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.218866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.220367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:09.236251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:09.237160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:09.238045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:09.238045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:09.238045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:09.238045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:09.238045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 425/837] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:09.238324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.259060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.291049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.296690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389567-a8f4-4997-801f-65023efeb7db None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.337452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.338378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.338683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.338945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.339801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:09.340119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.341557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.353551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 413/838] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:09.354360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.361787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd03e7-ac89-4d39-a856-58f700a42f42 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.405032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.405686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.405964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.406244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.406956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.408278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:09.417753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:09.418742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:09.419587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 426/839] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:09.420420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.468532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad81d-43c2-45cb-a834-5dbebb1c82e5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.493838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.503241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.504159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.504774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.505288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.506186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:09.506702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.509020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.521784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 414/840] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:09.522853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.539040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f881f0-cd6a-4902-b31a-7d70ccc4b1d9 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.550199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.574738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.575363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.575644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.575966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.576767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=f27a1a3e92fa4293a57b8b4024d065b5) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:09.577087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.578839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.587228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 427/841] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/role_assignments?user.id=f27a1a3e92fa4293a57b8b4024d065b5&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:09.588067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.654435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b25b5-b9fb-4967-8372-2668f613966f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.694899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.695582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.695987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.696283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.697604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:09.697604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.698680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae7edc-fb40-4279-94dd-62e6cacf5f91 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.704349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 415/842] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:09.707555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8015-5640-4654-961a-85fa6491f8ed None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.707879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8015-5640-4654-961a-85fa6491f8ed None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.708161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8015-5640-4654-961a-85fa6491f8ed None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.709485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 416/843] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:09.714237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8015-5640-4654-961a-85fa6491f8ed None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.735352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a8b3-33f2-4498-b489-91198dc1b908 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.771256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.778560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.779276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.782629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.782629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.788109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.790329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-15cee284-e291-4065-a2c4-071f22282748 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:09.802972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:09.804440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:09.805934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 428/844] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:09.806557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.806557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.807514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.828567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:09.829924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:09.835564 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8015-5640-4654-961a-85fa6491f8ed None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:09.862607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:09.875086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:09.882008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:09.882008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:09.882008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:09.882008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:09.882008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:09.882008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:09.891158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 417/845] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:09.891158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:09.918932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 429/846] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:09.943832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.019532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721beb0-034b-4d70-acb6-49da77724c6c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.040964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.065838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a8246-eb0e-435a-8ab8-8bc6669a3e74 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.080943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.080943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.081215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.081449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.082616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:10.082616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.083996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.104780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 418/847] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:10.111092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.117896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.118906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.119194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.119466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.130861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:10.136418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:10.137388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:10.138288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 430/848] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:10.143571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.173918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.247265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5122-7d39-4612-b5f6-85d11655736f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.258601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307c0e-5d25-48de-9d17-24f9a0f2d56f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.294944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.295498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.295805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.296089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.310065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.310940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.311382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.311825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.312690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:10.313139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.314667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.328062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 431/849] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:10.330629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.348645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.377476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.380077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.440895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.454915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5229-92f8-4e64-a5bb-564c25f23922 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.490432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.491486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.495791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.495791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.509518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.511195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:10.526475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:10.527579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:10.528662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:10.528662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:10.528662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:10.528662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:10.535342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 432/850] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:10.536043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 419/851] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:10.537034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.537205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.640172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.646586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4597e-73ae-4d09-99ee-dad5f6122e14 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.648530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c03e08-6769-438b-8029-135b93b21596 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.734759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.735690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.736191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.736652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.737632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:10.738161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.739771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.739981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.740737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.741021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.741294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.748405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.753558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.755234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.760277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 433/852] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:10.760277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:10.772121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:10.773022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:10.774429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:10.774429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:10.774429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:10.774429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:10.779859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 420/853] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:10.782431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.869745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d83921-b033-4352-966b-63ee48dfb67a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.906804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a44e5-53cb-40a3-8620-72a02764bf2a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:10.907324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.908067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.908463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.908742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] PATH_INFO: `/v3/users/swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.916962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.918548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:10.932017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:10.932976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:10.933912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 434/854] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:10.938404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:10.939721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:10.949365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:10.954679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:10.954679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:10.954679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:10.954679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:10.954679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:10.954679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:10.971638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 421/855] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:10.977793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.008152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:11.052564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bed66-3f05-4bae-8b96-e5077c26d1db None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.090572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.091200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.091489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.091786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.092621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:11.092937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.094371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.114132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422874-519b-4e82-9ce7-76fd4ff8383a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.117727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 435/856] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:11.118650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.161465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.162505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.163547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.164183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.174309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.175800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:11.189631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:11.190812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:11.191918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:11.193866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 422/857] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:11.199945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.246305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a679-ab40-409f-8273-1d3ced0238ec None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.268087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:11.270410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:11.298976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.299562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.299882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.300163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.347347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c263e-d96f-443e-ba35-86cc03f156b8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.375780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.377383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.387892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.388830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.389292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.389744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.390829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:11.391298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.393043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.407924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 423/858] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:11.413887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.500546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 436/859] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:35:11.505782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.528680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:11.546426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485b3df-9c7e-47ef-bb72-b537e4d5cc72 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.549742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:11.588912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.589892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.590412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.590842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.591950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=84424cb942bb42afbd8f2b4b7d704e5c) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:11.592409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.594139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.601401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 424/860] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/role_assignments?user.id=84424cb942bb42afbd8f2b4b7d704e5c&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:11.622763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072fd80-ab40-477b-9608-6395eaf20b2f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.665035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.665976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.666418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.666849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.679274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.681794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-b807bf29-eacb-4fc4-b0d7-9cb24a3a2df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:11.699534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:11.700788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:11.701901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:11.701901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:11.701901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:11.701901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:11.703914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 437/861] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:11.710049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.778791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90969d-b24e-4462-a4e6-14b02a4f80f6 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.779501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90969d-b24e-4462-a4e6-14b02a4f80f6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.780699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90969d-b24e-4462-a4e6-14b02a4f80f6 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.782551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 438/862] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:11.793261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.793769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.794410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.818849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:11.820981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:11.841046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5ca5-69a7-4f41-94e3-a8c6d77beff0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:11.884879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:11.885636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:11.885921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:11.886200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:11.886913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:11.887222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:11.888643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:11.905045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 425/863] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:11.905769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:11.911502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.911884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 439/864] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:11.935050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:11.949861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:12.037956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f67b-174d-41e9-8134-b53e89d6c16b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.047635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3a8b-fb77-4af3-8009-c378f29fa831 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.077374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.078131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.078418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.078696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.086540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.087205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.087437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.087546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.087768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.088423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.088944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.089783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:12.099473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:12.100603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:12.102359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 440/865] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:12.106117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:12.107083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:12.108236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 426/866] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:12.108803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:12.111971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:12.187545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:12.211744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:12.227405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db05c52-5c36-4284-87c2-3356124e89b0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.231989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08167fd-42c0-44d2-94c0-fccf1f355553 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.268465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.269255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.269547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.269649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.269842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.270217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.270505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.270610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:12.270788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.270883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.271473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:12.271804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.272353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1e1e9-7674-472e-a5a7-fc476bb0d001 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.273184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ab112-e80b-423a-b86d-f697129139e7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.280579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 441/867] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:12.280579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095b1f-bda0-4c80-9e42-641058e3fc76 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.280579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095b1f-bda0-4c80-9e42-641058e3fc76 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.280579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095b1f-bda0-4c80-9e42-641058e3fc76 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.286061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 442/868] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:12.286061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0095b1f-bda0-4c80-9e42-641058e3fc76 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:12.297023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 427/869] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:12.297023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.297023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.297023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.318198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:12.319657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:12.398544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 428/870] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:12.398544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:12.415418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0095b1f-bda0-4c80-9e42-641058e3fc76 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.444080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:12.452738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.453360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.453839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.453949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.454612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:12.455044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.456462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.471918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 443/871] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:12.471918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:12.497511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:12.523668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40504cba-59cb-4f7f-80fb-66ce26fcf327 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.566373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.567145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.567434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.567721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.568691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=702abbf0ba844ec99db46a7b0c54b288) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:12.569010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.571226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe6113-dd82-453f-beba-f73cf7ac7a9f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.587790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 429/872] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:12 2022] GET /identity/v3/role_assignments?user.id=702abbf0ba844ec99db46a7b0c54b288&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:12.612440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedfa77-a53d-4ab5-ab8c-e6dd0737bb17 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:12.654840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1728a-6569-4de4-bb73-f6f4574e3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:12.655584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1728a-6569-4de4-bb73-f6f4574e3343 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:12.655919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1728a-6569-4de4-bb73-f6f4574e3343 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:12.656202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1728a-6569-4de4-bb73-f6f4574e3343 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:12.657025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1728a-6569-4de4-bb73-f6f4574e3343 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:12.658416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1728a-6569-4de4-bb73-f6f4574e3343 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:12.735603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 444/873] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:12 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:13.806820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc003a-357b-4a26-a77e-8dd324e24f68 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:13.807534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc003a-357b-4a26-a77e-8dd324e24f68 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:13.807534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc003a-357b-4a26-a77e-8dd324e24f68 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:13.808929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 430/874] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:13.817603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:13.817603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:13.817603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:13.834430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:13.836032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:13.884219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:13.915906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 445/875] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:13.935323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc003a-357b-4a26-a77e-8dd324e24f68 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.039969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc003a-357b-4a26-a77e-8dd324e24f68 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.078017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.078586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.078874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.079152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.091367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:14.096445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:14.097483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:14.098313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 431/876] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 25 22:35:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:14.104070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.207937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eaf07-469b-4e3c-a420-0854c43589cd None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.244923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.245568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.245866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.246149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.246892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:14.247202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:14.248625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:14.258437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 446/877] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:35:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:14.264007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.267660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:14.376264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c78fe-0263-4677-8bfd-58ccee0cc6a5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.412202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.412847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.413126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.413400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.424815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:14.426279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-841d95ab-599c-4f89-8693-d5c43589afe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:14.442412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:14.443338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:14.444282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:14.444282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:14.444282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:14.444282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:14.447986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 432/878] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:14.452832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.498384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:14.562663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c47fbe-d69c-4b07-ba8d-c64dd910941e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.583633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7f66-c9c2-4b79-8e9d-582cdcab18a9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.584045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7f66-c9c2-4b79-8e9d-582cdcab18a9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.584403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7f66-c9c2-4b79-8e9d-582cdcab18a9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.586780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 433/879] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:14.592275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3155-8003-4da4-be50-2984d5ebeb01 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.592641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3155-8003-4da4-be50-2984d5ebeb01 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.592989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3155-8003-4da4-be50-2984d5ebeb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.600273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.601012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.601344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.601636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.602343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:14.602653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:14.604045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:14.614161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-94dc3155-8003-4da4-be50-2984d5ebeb01 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:14.615740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-94dc3155-8003-4da4-be50-2984d5ebeb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:14.618096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 447/880] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:14.624283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.681653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:14.711661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 434/881] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:14.725162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9831-b96b-4df0-97b2-2b5ab630407a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.725430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9831-b96b-4df0-97b2-2b5ab630407a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.725724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9831-b96b-4df0-97b2-2b5ab630407a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.731697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 435/882] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:14.732933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.733213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.733496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.745155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:14.749319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b57de7-9bad-4de2-9e1e-d63f88a6d151 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.753285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:14.754489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:14.788463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.789614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.789902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.790178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.797620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:14.799062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:14.812467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:14.813486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 448/883] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:35:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:14.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.839400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 436/884] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:14.840363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:14.928032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91281-d817-4125-99dd-1145fa4bbc04 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.949230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22b3b3-75b1-4bc6-9b3b-740433e942e5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:14.962507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9fe89-93d3-4a1c-a993-040a72034577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.963112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9fe89-93d3-4a1c-a993-040a72034577 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.963397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9fe89-93d3-4a1c-a993-040a72034577 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.963678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9fe89-93d3-4a1c-a993-040a72034577 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.963835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:14.964478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9fe89-93d3-4a1c-a993-040a72034577 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:14.965772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9fe89-93d3-4a1c-a993-040a72034577 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:14.984344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:14.984982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:14.985249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:14.985526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:14.986322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:14.986631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:14.988134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.005964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 437/885] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 25 22:35:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:15.006749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.047267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 449/886] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:14 2022] POST /identity/v3/services => generated 269 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:15.048591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289402-5d23-463a-bb0f-7d6906a21b2e None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.048912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289402-5d23-463a-bb0f-7d6906a21b2e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.049168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289402-5d23-463a-bb0f-7d6906a21b2e None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.050409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 450/887] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:15.051966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289402-5d23-463a-bb0f-7d6906a21b2e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.079173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.122154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cee59b-a6d7-4972-a137-635df909f0cc None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.168750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.169414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.169700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.169978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.170619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.172145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-cb783e99-d4e9-400a-b316-ea1315848bec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:15.182282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:15.183354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:15.184268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 438/888] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:15.185052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.185534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.185534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.193316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289402-5d23-463a-bb0f-7d6906a21b2e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.208210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:15.209334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:15.235616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.236459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.236829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.237176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.242091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.292149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 439/889] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:15.301110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.317944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.319568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.340665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.417185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a192f-a2a3-4dc0-a244-b14f0872c755 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.435704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 451/890] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:35:15.435704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.460158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.461526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.461815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.462091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.462779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:15.463086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.464504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.474199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 440/891] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:15.475064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.506491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.540654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37725f0-f0c0-4d04-8d5c-72762047a764 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.561301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.581647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.582633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.583049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.583299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.583934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.585349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.592657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc8bd-9ed3-4ca1-ab2d-a3fc5a22ddb3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:15.595960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:15.596927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:15.597753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 452/892] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:15.598545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.632950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.633678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.633969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.634501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.645780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.647645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:15.665295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:15.666268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:15.667149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:15.667149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:15.667149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:15.667149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:15.667149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 441/893] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:15.667431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.716004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfa3d9-b290-468c-8daf-6c2e85b95df8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.752333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.752952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.753239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.753517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.754201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:15.754508 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.755895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.759964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.761427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 453/894] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:15.762236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.803683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60567ed7-ef51-4494-b8f6-953dd1b0e28a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.829786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:15.846581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.847275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.847612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.847888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.848601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:15.851393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.851393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.860653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 442/895] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:15.863580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.904433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb86ba-f3ee-4331-83ad-76140477f8bc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:15.946477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:15.947634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:15.947962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:15.948242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:15.949084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:15.949528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:15.951067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:15.970146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 454/896] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:15.975850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:15.990209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0285-bed3-4869-b71f-4e6fb9532198 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:16.037425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:16.038574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:16.039080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:16.039539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:16.040288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:16.040605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:16.042486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:16.094750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3963-78a3-4e09-83d3-9e4943551bda None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:16.095662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 443/897] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:16.101851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:16.104546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:16.112523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:16.133291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:16.133949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:16.134228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:16.134498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:16.141729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:16.143549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:16.156562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:16.157506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:16.158377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 455/898] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:16.164258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:16.230729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d02f4-f652-4f4b-b2e6-0026a5ac2d92 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:16.287849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:16.288515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:16.289282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:16.289560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:16.290835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] RBAC: Adding query filter params (interface=public, service_id=1a68a9007ccb46f9a6a6e4faab59d1af, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:16.291155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:16.293119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:16.297017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a1847-c13e-4421-a033-045645b5a547 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:16.303914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 444/899] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:16 2022] GET /identity/v3/endpoints?service_id=1a68a9007ccb46f9a6a6e4faab59d1af&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:16.310698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:16.357803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:16.358487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:16.358779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:16.359110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:16.361039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:16.361360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:16.362803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:16.380198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 456/900] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:16.386341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:16.399632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:16.425384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:16.435063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81109582-2285-4f60-8554-0d5bdfec2566 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:16.471260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec65b22-c855-4731-8c34-008753bb05cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:16.472288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65b22-c855-4731-8c34-008753bb05cd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:16.472802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65b22-c855-4731-8c34-008753bb05cd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:16.473347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65b22-c855-4731-8c34-008753bb05cd None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:16.474244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec65b22-c855-4731-8c34-008753bb05cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:16.475828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec65b22-c855-4731-8c34-008753bb05cd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:16.483212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 445/901] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:16 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:35:16.521010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eda6d2-3166-4426-ac02-182a301f3dd4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:16.562712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:16.563740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:16.564264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:16.564745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:16.565836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] RBAC: Adding query filter params (role.id=6a8e9bce321441f49dd66e8341032a2b, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=84424cb942bb42afbd8f2b4b7d704e5c) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:16.566368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:16.568098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe735-193b-4225-917f-9d2c9da95b7f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:16.575345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 457/902] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:16 2022] GET /identity/v3/role_assignments?user.id=84424cb942bb42afbd8f2b4b7d704e5c&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=6a8e9bce321441f49dd66e8341032a2b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:17.163100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d8e6-08e1-459e-97ea-a042f10f7df7 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.164732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d8e6-08e1-459e-97ea-a042f10f7df7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.165303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d8e6-08e1-459e-97ea-a042f10f7df7 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.167161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 446/903] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:17.172635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.173468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.174006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.193624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:17.195298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:17.267509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 458/904] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:17.291616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7d8e6-08e1-459e-97ea-a042f10f7df7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:17.406559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7d8e6-08e1-459e-97ea-a042f10f7df7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:17.443221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:17.444417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.445001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.445486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.446529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:17.448187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:17.450664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:17.458994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:17.465708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:17.466545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 447/905] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jul 25 22:35:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:17.470704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:17.497559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:17.580541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5ee30-2914-4d9c-9c14-7933047cffb5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:17.618096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:17.618783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.619068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.619346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.620120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:17.620428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:17.621798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:17.627045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 459/906] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:17.633191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:17.751407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad525-22eb-4596-b893-910847be8801 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:17.787358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:17.788024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.788311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.789256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.789960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:17.790264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:17.791640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818a637-5898-45f6-afe9-998b479920d2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:17.797141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 448/907] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:17.802989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:17.843499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d74dc-8d01-4544-8056-e6979787b8f0 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.844184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d74dc-8d01-4544-8056-e6979787b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.844749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d74dc-8d01-4544-8056-e6979787b8f0 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.846557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 449/908] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:17.853068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.853618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.854123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.876880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:17.878501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:17.909324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:17.927310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2027d-8a5a-4af1-a048-9317e3ec2294 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:17.947515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:17.963810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 450/909] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:17.969435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:17.970059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:17.970348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:17.970632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:17.971393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] RBAC: Adding query filter params (interface=public, service_id=3e4fde872f8745859db1448475022d81, region_id=RegionOne) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:17.971708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:17.973108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:17.980030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 460/910] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:17 2022] GET /identity/v3/endpoints?service_id=3e4fde872f8745859db1448475022d81&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:17.986014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:17.993084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:18.100748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95ce86-d9ab-424e-8260-f1d5e35f6a18 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:18.102469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f7c3-c2a5-406c-a7c0-3cf2116816eb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:18.137210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936e964-52ca-4585-ba61-2741bc6ac16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:18.137841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936e964-52ca-4585-ba61-2741bc6ac16d None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.138125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936e964-52ca-4585-ba61-2741bc6ac16d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.138401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936e964-52ca-4585-ba61-2741bc6ac16d None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.139114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936e964-52ca-4585-ba61-2741bc6ac16d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:18.140825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936e964-52ca-4585-ba61-2741bc6ac16d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:18.142849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70430b-0dda-44aa-8115-59582005c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:18.143737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70430b-0dda-44aa-8115-59582005c25c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.144372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70430b-0dda-44aa-8115-59582005c25c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.144866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70430b-0dda-44aa-8115-59582005c25c None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.145859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70430b-0dda-44aa-8115-59582005c25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:18.147664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70430b-0dda-44aa-8115-59582005c25c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:18.158401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 451/911] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:17 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:35:18.225199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 461/912] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:17 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:18.629690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207b671-334a-48ec-83ce-8403db17d3d4 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.630221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207b671-334a-48ec-83ce-8403db17d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.630221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207b671-334a-48ec-83ce-8403db17d3d4 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.631877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 452/913] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:18.637820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.638111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.638385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.661577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:18.664088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:18.666771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:18.703845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34293b8a-15bc-446e-9471-8bc36b20f3b3 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.707744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34293b8a-15bc-446e-9471-8bc36b20f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.707744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34293b8a-15bc-446e-9471-8bc36b20f3b3 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.707744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 453/914] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:18.712275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.712639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.712884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.731999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:18.733208 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:18.750715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 462/915] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:18.773523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:18.800333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:18.823854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 454/916] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:18.847714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:18.900226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fa700-58e9-4f8e-a0de-482ef10f0f78 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:18.945643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:18.947090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:18.947835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:18.948325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:18.951194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:18.965840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:18.970492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f47c-1519-49e8-87dd-ca697747e7ce None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:18.970919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:18.971925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:18.972822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:18.978149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 463/917] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 25 22:35:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:18.979113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.022230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.022936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.023370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.023713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.024390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.025767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:19.035807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:19.036844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:35:19.037651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:19.042238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 455/918] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:19.043448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.097168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:19.102676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57e344-18c7-44d9-a4e4-a40d8238c8ad None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.141213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.142161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.142734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.143195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.144195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:19.144731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.146501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.153387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfbe2a-cec0-45c9-984a-34546add7dcb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.156705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 464/919] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:35:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:19.167845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.190510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.191967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.192462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.193159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.194333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:19.196047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.198268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.205878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 456/920] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:19.212753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.239449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:19.310065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d3ead-3c26-49ca-a756-3decbf174780 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.347179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.348446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.349004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.349549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.353103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070d8f-915e-4376-9f92-8471de0cf36c None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.362782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.364725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.368923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:19.382427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:19.384312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:19.384312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:19.384312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:19.384312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:19.386544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 465/921] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:19.392897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.394816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.396165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.397536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.398171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.399139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:19.400667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.402345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.413783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 457/922] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:19.415158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.523823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff05af7-a415-407a-8f8d-cedb04c2db93 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.534425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4387-02c2-43c1-ba6b-0377fbed43c8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.536683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:19.567820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.569000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.569649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.570794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.571870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:19.572457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.574192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.577363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.578720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.579017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.579298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.580068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.581532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.590910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 466/923] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:19.596944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.691473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 458/924] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:19.718896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda8883-b856-4ad9-9557-55c562869700 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.768530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.769200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.769491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.769773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.778753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.780262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:19.794025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:19.795077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:19.796228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 467/925] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:19.801344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:19.843345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:19.917086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe99f-1441-4785-afd1-327c09fc114e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:19.954554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:19.955156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:19.955451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:19.955731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:19.956583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:19.956897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:19.958357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:19.981453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 459/926] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:19.984645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.013908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:20.096196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a2dd3-9088-48a6-a3d1-f37fe80a8973 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.135384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.136068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.136354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.136632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.148448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.150023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-7ffad550-358d-4fd6-a5c3-db8be405c821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:20.166064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:20.167018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:20.167974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:20.167974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:20.167974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:20.167974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:20.167974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 468/927] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:20.173335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.275568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:20.290586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822d34-94ea-45fa-bcf6-5d231fda1d2b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.326763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46f5a-8878-4dff-810f-79dc45e42e98 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.327289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46f5a-8878-4dff-810f-79dc45e42e98 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.327408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46f5a-8878-4dff-810f-79dc45e42e98 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.328708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 469/928] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:20.333702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616572-a01f-48b5-b9dd-334ba490fb8a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.333991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616572-a01f-48b5-b9dd-334ba490fb8a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.334274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616572-a01f-48b5-b9dd-334ba490fb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.336136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.337114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.337601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.338134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.339053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:20.339559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.341168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b246-c3db-4448-864e-cf47cd0d7572 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.354800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 460/929] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:20.355005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-40616572-a01f-48b5-b9dd-334ba490fb8a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:20.356142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-40616572-a01f-48b5-b9dd-334ba490fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:20.356719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896a97-2425-4aef-8e48-18787ddfd51d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.357214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896a97-2425-4aef-8e48-18787ddfd51d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.357679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896a97-2425-4aef-8e48-18787ddfd51d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.359647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 461/930] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:20.363589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896a97-2425-4aef-8e48-18787ddfd51d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.430385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 470/931] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:20.432165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.432526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.432883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.452196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:20.458857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:20.460966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:20.485596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896a97-2425-4aef-8e48-18787ddfd51d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.524008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.525215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.525520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.525857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.535822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 471/932] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:20.535822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.539119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.540687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:20.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:20.557877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:20.558908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 462/933] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:20.559609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.576750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:20.654114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c2bc-7347-4465-a0ee-4c054845bc2a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.670575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08459-1a9e-4da5-854c-fea86ca45bff None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.691740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.692419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.692708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.692992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.693627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.695649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.698425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:20.705310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:20.706428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:35:20.707444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:20.712238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 472/934] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:20.716025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.716504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.716603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.716603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.716603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.716603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.716603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:20.725210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:20.726230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:20.727071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 463/935] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:20.728581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.816044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:20.826487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e7ce7-ddc8-4514-a456-430c4886a8e4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.842509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210c7b-45b9-4a26-9e88-d4f04ed3ded9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:20.870846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.871452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.871741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.872054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.876704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:20.877020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.878454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.878854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:20.879468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:20.879765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:20.880063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:20.881513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:20.881513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:20.882914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:20.887893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 464/936] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:20.888682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.899072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 473/937] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:20.900251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:20.969797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:21.007949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea8a4-5d16-416e-b97b-aaf6345d952a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.020196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066e5c-c1b7-4fd5-a4fb-5fce281b11ac None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.045196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.046194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.046481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.046763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.047450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:21.047771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.053923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.059020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 465/938] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:21.059810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:21.060683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.061309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.061596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.061875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.062894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:21.063322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:21.064099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.065482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.074136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 474/939] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:21.074136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:21.173949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0d1e-0e6a-4217-bf37-c4f2d835cb45 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.180304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00db02d-9fa8-4b58-95f4-d32881c196e4 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.205619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:21.215750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.216871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.217388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.217711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.217997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/84424cb942bb42afbd8f2b4b7d704e5c/roles/6a8e9bce321441f49dd66e8341032a2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.218332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.218615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.218891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.219588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:21.219953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.221171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=84424cb942bb42afbd8f2b4b7d704e5c, role_id=6a8e9bce321441f49dd66e8341032a2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.221314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.223047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.231834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 475/940] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:21.231834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:21.310452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 466/941] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:21 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/84424cb942bb42afbd8f2b4b7d704e5c/roles/6a8e9bce321441f49dd66e8341032a2b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:21.311527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:21.356306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892d33f-96ca-4b97-8d1d-8a5edce94d9f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.399440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b25f9-86ec-4a04-94e1-ef6e2d7e6884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.400942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b25f9-86ec-4a04-94e1-ef6e2d7e6884 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.401483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b25f9-86ec-4a04-94e1-ef6e2d7e6884 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.401924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b25f9-86ec-4a04-94e1-ef6e2d7e6884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.403008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b25f9-86ec-4a04-94e1-ef6e2d7e6884 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.405337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b25f9-86ec-4a04-94e1-ef6e2d7e6884 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.407283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:21.456709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6a8e6-3780-47fd-b137-10af6ddfeb90 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.504314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.505058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.505345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.505662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.506545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] RBAC: Adding query filter params (interface=public, service_id=18513e505ea849059a6cb46b00b31bf3, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:21.507040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.508593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.515221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 467/942] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:21 2022] GET /identity/v3/endpoints?service_id=18513e505ea849059a6cb46b00b31bf3&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:21.520655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:21.540941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 476/943] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:21.655531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357892f-2909-45c7-a1ec-d4a66bab8ee7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:21.696232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:21.715528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fe9b-37e5-4c50-86b7-903389e4cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:21.716403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fe9b-37e5-4c50-86b7-903389e4cf87 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.716940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fe9b-37e5-4c50-86b7-903389e4cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.717124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fe9b-37e5-4c50-86b7-903389e4cf87 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.717995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1fe9b-37e5-4c50-86b7-903389e4cf87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:21.719818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1fe9b-37e5-4c50-86b7-903389e4cf87 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:21.729941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 468/944] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:21 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:35:21.879686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c94de-f992-4629-b1ed-ef585a634d3f None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.880109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c94de-f992-4629-b1ed-ef585a634d3f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.880288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c94de-f992-4629-b1ed-ef585a634d3f None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.881749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 477/945] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:21.887498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:21.887827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:21.888109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:21.908048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:21.909447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:21.981767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 469/946] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:22.004653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c94de-f992-4629-b1ed-ef585a634d3f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:22.057931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:22.123849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c94de-f992-4629-b1ed-ef585a634d3f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:22.161581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:22.162105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:22.162385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:22.162664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:22.163588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:22.165439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:22.168142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING keystone.server.flask.common [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 22:35:22.217303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.sql.core [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:35:22.217303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:35:22.217303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [parameters: {'id': '9113a637fe684210b6b4876abe01815f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:35:22.217303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9113a637fe684210b6b4876abe01815f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9113a637fe684210b6b4876abe01815f. Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:35:22.233252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application result.read() Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 22:35:22.234291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application yield resource Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise self.value Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application session.commit() Jul 25 22:35:22.235233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:35:22.236202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:35:22.237093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application result.read() Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:35:22.238913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [parameters: {'id': '9113a637fe684210b6b4876abe01815f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:22.240466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:22.241476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9113a637fe684210b6b4876abe01815f. Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:22.242549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 478/947] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Jul 25 22:35:22 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:22.247506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:22.357310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8a143-6cb0-42e1-880f-2c50a42fbcf7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:22.376631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:22.394281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03622738-be9e-4455-996f-c507e679b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:22.394922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622738-be9e-4455-996f-c507e679b203 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:22.395207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622738-be9e-4455-996f-c507e679b203 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:22.395483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03622738-be9e-4455-996f-c507e679b203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:22.402679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03622738-be9e-4455-996f-c507e679b203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:22.404158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03622738-be9e-4455-996f-c507e679b203 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-03622738-be9e-4455-996f-c507e679b203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:22.417078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:22.419119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:22.421324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 470/948] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:22.429947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:22.537087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:22.541484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cf392-3b15-42db-9ea4-f03bd6db812b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:22.580131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:22.580767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:22.581053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:22.581335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:22.582216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:22.582597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:22.584288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b04ed-0b61-4f5f-838a-319e656344c3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:22.607859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 479/949] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:23.460168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fd7c2-4c0a-4462-98bc-dc4d1b7301ca None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.460689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fd7c2-4c0a-4462-98bc-dc4d1b7301ca None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.460909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fd7c2-4c0a-4462-98bc-dc4d1b7301ca None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.462498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 471/950] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:23.468192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34624b-f4c0-4fec-9952-fdbebbe39b74 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.468697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34624b-f4c0-4fec-9952-fdbebbe39b74 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.468865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34624b-f4c0-4fec-9952-fdbebbe39b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.487694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5e34624b-f4c0-4fec-9952-fdbebbe39b74 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:23.489237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5e34624b-f4c0-4fec-9952-fdbebbe39b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:23.564032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 480/951] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:23.587849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fd7c2-4c0a-4462-98bc-dc4d1b7301ca None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:23.693633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fd7c2-4c0a-4462-98bc-dc4d1b7301ca None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:23.721980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2de2c3-08d0-4b29-adc4-8d7e64ccf0d6 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.722321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2de2c3-08d0-4b29-adc4-8d7e64ccf0d6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.722543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2de2c3-08d0-4b29-adc4-8d7e64ccf0d6 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.725252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 481/952] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:23.729752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.730040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.730321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.736900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:23.737827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.738133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.738402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.749601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:23.751974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:23.753190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:23.755320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:23.756526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:23.758372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 472/953] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 25 22:35:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:23.762938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:23.806288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:23.844561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 482/954] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:23.865722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:23.890782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413454-c18b-4d6a-8b7a-504e96eaff36 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:23.893023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:23.939700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:23.940363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.940643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.940913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.941638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:23.941945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:23.943296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0851c-47b3-42ed-9f31-604598b62068 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:23.952774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 473/955] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:35:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:23.957984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04959-3229-484d-a35d-b6f964789ae5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:23.957984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04959-3229-484d-a35d-b6f964789ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:23.957984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04959-3229-484d-a35d-b6f964789ae5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:23.957984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 474/956] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:23.959818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04959-3229-484d-a35d-b6f964789ae5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:23.995332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e494f1c-15c4-4683-a6a3-8e4f20e83977 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.034167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.034805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.035094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.035369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.036040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.037407 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-b3d4184b-5eba-4306-ae1d-482a42eff1e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:24.047834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:24.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:24.056525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 483/957] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:24.057412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.057412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.057412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.070968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.074801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:24.075279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04959-3229-484d-a35d-b6f964789ae5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.076166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:24.114000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.114652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.115084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.115383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.127981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.129625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:24.144666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:24.145596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:24.146462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:24.146462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:24.146462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:24.146462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:24.146462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 475/958] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:24.146742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.161681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 484/959] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:24.165275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.185796 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.265194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57796-cecf-45a6-9f37-a8039e250f64 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.279169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8ccc-f725-44eb-801d-8f2d7eff1818 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.312845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.313472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.313759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.314040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.314780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:24.315099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.316608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.316831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.317445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.317732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.318005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.318698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:24.319001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.322010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.329102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 476/960] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:24.329102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.335646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 485/961] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:24.340435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.350469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.423623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.447356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ff56-e7fb-4357-b827-887923692bbb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.449554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9817-bf20-429e-b840-cd5052c6c222 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.485755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.486405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.486688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.486963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.487105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.487695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.487804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.488017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.488220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.488916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:24.489028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.489224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.490579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.503738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 486/962] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:24.503738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:24.504093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:24.505036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:24.505877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 477/963] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:24.512315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.632207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.639975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c4e7-f097-47fe-8f94-837f27d1ce92 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.652128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a944-1c11-4ce2-9d06-a8d30edbd7fa None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.685421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.685622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.685846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.686096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.696186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.697642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.698382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.699014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.699297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.699570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.699676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.700286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:24.700593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.702578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.707809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 478/964] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:24.711571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:24.712695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:24.714325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 487/965] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:24.714980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.718276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.828436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b49f0a-a882-4eb8-908e-dd29611faa8d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.832582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a5ce-3100-4efd-9ee3-1a66818a1086 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:24.864911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.865537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.865825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.866655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.867649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:24.867992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.869433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91705900-24c8-448a-9a9b-9ce66a838e77 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.871430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:24.872300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.872574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.872866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.873550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:24.873861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:24.875202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbcdc2-3d0e-4036-997d-d51dd6c0ba04 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:24.885663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 479/966] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:24.885663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8c47-b457-455d-baec-7d2790a52063 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.885663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8c47-b457-455d-baec-7d2790a52063 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.885663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f8c47-b457-455d-baec-7d2790a52063 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.885663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 480/967] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:24.890998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f8c47-b457-455d-baec-7d2790a52063 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:24.892179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 488/968] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:24.893498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:24.893783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:24.894065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:24.904353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.912736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:24.917005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:24.971467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:24.989779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 489/969] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:24.990752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.012657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f8c47-b457-455d-baec-7d2790a52063 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.052311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.052941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.053236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.054044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.054756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.056327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.099882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1966c6-a6f7-4518-bcb3-9dce48464a53 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.144039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 481/970] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:35:25.145420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.156020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.156687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.156994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.157273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.222209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:25.246785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.248338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.255666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:25.312612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ac02-0c7e-42d1-881d-f75814f499f3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.356498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.357614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.357905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.358187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.359239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.361065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.364185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING keystone.server.flask.common [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 22:35:25.384809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 490/971] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:35:25.390709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.411836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.sql.core [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:35:25.411836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:35:25.411836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [parameters: {'user_id': 'fb1d6e9582104c798e4dfd3767fd8bf7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:35:25.411836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result.read() Jul 25 22:35:25.424875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:35:25.425769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application yield resource Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise self.value Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application session.commit() Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:35:25.426748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:35:25.427667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:35:25.429334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application result.read() Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:35:25.430542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fb1d6e9582104c798e4dfd3767fd8bf7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:25.431376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 22:35:25.432523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 22:35:25.433498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 22:35:25.433498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 22:35:25.433498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:35:25.433498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:35:25.433498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:35:25.433498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:25.436223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 482/972] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 25 22:35:25 2022] POST /identity/v3/users => generated 160 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:25.442718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.496122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:25.517723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db5945-2278-4c63-9f46-c855151ef07d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.567531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.568203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.568490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.568768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.582026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.583533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.588264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a90028-5e81-4839-9ddf-6cd9cd1eef1a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:25.606685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:25.607627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:25.608577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:25.608577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:25.608577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:25.608577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:25.610381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 491/973] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:25.617568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.624712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:25.635458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.636155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.636445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.644509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.645454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.647949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:25.661033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:25.662272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:35:25.664253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:25.667813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 483/974] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:25.673807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.766773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965baaac-9aeb-4f34-b01f-1bfee404db4d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.787656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8730e-54b3-472c-b694-b304b76d27b6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.813223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.813842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.814125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.814402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.815540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:25.815871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.817519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.820745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:25.828557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.829524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.830039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.830615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.831736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:25.832304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.834176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:25.839220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 492/975] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:25.840952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:25.896554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 484/976] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 25 22:35:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:25.948248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235afac-5ae7-47bf-9c1d-5874153b343b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:25.984752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:25.985415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:25.985699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:25.985976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:25.994222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:25.995811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:26.009358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:26.016499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:26.017456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 493/977] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:26.017995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:26.079316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:26.140235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6710ba-cb09-4cae-abc9-941ddb248e38 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:26.180757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:26.181390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:26.181674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:26.182028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:26.182716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:26.183020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:26.184601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280041-31a5-4d26-9fb2-2b9cac314e15 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:26.202552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 485/978] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:26.204886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:26.265821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:26.323124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911850-e859-42e4-b4c7-5c696ba8f3fe None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:26.362658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:26.363302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:26.363554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:26.363856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:26.364650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] RBAC: Adding query filter params (role.id=6a8e9bce321441f49dd66e8341032a2b, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=84424cb942bb42afbd8f2b4b7d704e5c) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:26.364957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:26.366960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110cc71-229d-4af9-8094-075fc307789f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:26.379859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 494/979] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:26 2022] GET /identity/v3/role_assignments?user.id=84424cb942bb42afbd8f2b4b7d704e5c&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=6a8e9bce321441f49dd66e8341032a2b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:26.649882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98667-777a-4e2f-8be4-ae37a29e15be None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:26.650550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98667-777a-4e2f-8be4-ae37a29e15be None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:26.650550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98667-777a-4e2f-8be4-ae37a29e15be None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:26.652080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 486/980] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:26.657559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b32ebc-eec2-4388-9291-21449045453b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:26.657996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b32ebc-eec2-4388-9291-21449045453b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:26.658138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b32ebc-eec2-4388-9291-21449045453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:26.677646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-38b32ebc-eec2-4388-9291-21449045453b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:26.678879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-38b32ebc-eec2-4388-9291-21449045453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:26.750914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 495/981] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:26.774102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98667-777a-4e2f-8be4-ae37a29e15be None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:26.883119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98667-777a-4e2f-8be4-ae37a29e15be None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:26.885624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:26.920172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400ebd5-87db-45a7-8d7f-a469aadb0c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:26.920715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ebd5-87db-45a7-8d7f-a469aadb0c9a None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:26.921003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ebd5-87db-45a7-8d7f-a469aadb0c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:26.921284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ebd5-87db-45a7-8d7f-a469aadb0c9a None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:26.922001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400ebd5-87db-45a7-8d7f-a469aadb0c9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:26.923375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400ebd5-87db-45a7-8d7f-a469aadb0c9a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:26.996379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 487/982] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:26 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:27.251346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73954d9c-5e8b-4272-9159-df50e64e8365 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:27.251670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73954d9c-5e8b-4272-9159-df50e64e8365 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:27.251936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73954d9c-5e8b-4272-9159-df50e64e8365 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:27.253279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 496/983] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:27.258510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:27.258808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:27.259093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:27.281638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:27.283183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:27.365830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 488/984] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:27.388431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73954d9c-5e8b-4272-9159-df50e64e8365 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:27.440354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:27.496947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73954d9c-5e8b-4272-9159-df50e64e8365 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:27.534177 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:27.534734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:27.535013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:27.535286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:27.535956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:27.537313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:27.547315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:27.548374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:27.549216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 497/985] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:27.555253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:27.653082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:27.663901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497db7-f039-4f8a-9a6d-948835af45c6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:27.699077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:27.699744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:27.700056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:27.705230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:27.705230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:27.705230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:27.705230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:27.708324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 489/986] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:27.714605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:27.819818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e4e16-53f9-4818-847a-19218c91d65d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:27.833673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:27.856223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:27.856881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:27.857168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:27.857481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:27.858165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:27.858476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:27.859861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:27.870571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 498/987] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:27.871722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:27.977315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257875a-b2b1-487e-b632-855a5251d338 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:28.013704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:28.014462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:28.014627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:28.016506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:28.016506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] RBAC: Adding query filter params (interface=admin, service_id=18513e505ea849059a6cb46b00b31bf3, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:28.016506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:28.017426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e731-96ec-4adb-b349-e46dabcab9aa None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:28.027666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 490/988] 10.222.0.40 () {56 vars in 1249 bytes} [Mon Jul 25 22:35:27 2022] GET /identity/v3/endpoints?service_id=18513e505ea849059a6cb46b00b31bf3&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:28.029461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:28.139636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace18778-abdf-4b7e-9a37-3ee20427190b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:28.174697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1cd78-66ed-4dfc-98b4-4773a0100c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:28.175309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1cd78-66ed-4dfc-98b4-4773a0100c46 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:28.175590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1cd78-66ed-4dfc-98b4-4773a0100c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:28.175896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1cd78-66ed-4dfc-98b4-4773a0100c46 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:28.176549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1cd78-66ed-4dfc-98b4-4773a0100c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:28.177894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1cd78-66ed-4dfc-98b4-4773a0100c46 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:28.185253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 499/989] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:28 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:35:28.444437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd2f1-23d3-4be0-b1f7-d3ceffc7f707 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:28.444867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd2f1-23d3-4be0-b1f7-d3ceffc7f707 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:28.445153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd2f1-23d3-4be0-b1f7-d3ceffc7f707 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:28.446675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 491/990] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:28.451768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:28.452080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:28.452362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:28.471393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:28.472613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:28.509739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:28.547812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 500/991] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:28.565436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd2f1-23d3-4be0-b1f7-d3ceffc7f707 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:28.585169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:28.673951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd2f1-23d3-4be0-b1f7-d3ceffc7f707 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:28.710365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:28.710937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:28.711220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:28.711496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:28.712205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:28.713569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:28.722600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:28.723679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:28.725055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 492/992] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jul 25 22:35:28 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:28.730134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:28.835463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f798093-fe20-490e-915d-0b99ae7fca9c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:28.871081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:28.871711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:28.872029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:28.872309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:28.872999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:28.873313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:28.874783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefaaa4-f0a9-438d-83e9-5d5519a703a9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:28.884944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 501/993] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:28.886243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:28.971077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:28.989844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401d5b9-4d62-4eab-91fa-5e14185de9f4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:29.025751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:29.026377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.026660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.026933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.027796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] RBAC: Adding query filter params (type=image) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:29.028032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:29.029460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0a472-2935-45c9-bd69-119329d64bf1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:29.039257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 493/994] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:29.066985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1381c-232a-4b50-b48d-2d5d541d7750 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.067296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1381c-232a-4b50-b48d-2d5d541d7750 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.067560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1381c-232a-4b50-b48d-2d5d541d7750 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.069128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 502/995] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:29.075067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29310-6fbc-499c-8894-233a6525326f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.075383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29310-6fbc-499c-8894-233a6525326f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.075628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29310-6fbc-499c-8894-233a6525326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.098502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-87c29310-6fbc-499c-8894-233a6525326f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:29.099728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-87c29310-6fbc-499c-8894-233a6525326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:29.176759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 494/996] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:29.200107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1381c-232a-4b50-b48d-2d5d541d7750 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:29.239483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:29.316901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1381c-232a-4b50-b48d-2d5d541d7750 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:29.355059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:29.355714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.356032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.356312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.357317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:29.358688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:29.368515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:29.369520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:29.370471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 503/997] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:29.375802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29310-6fbc-499c-8894-233a6525326f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:29.454767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:29.479542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29310-6fbc-499c-8894-233a6525326f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:29.516947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:29.517475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.517761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.518041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.518814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:29.519038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:29.520494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:29.526640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 495/998] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:29.532621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:29.631985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:29.636452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1b946-8927-430c-9686-158670d51d7e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:29.671616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:29.672282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.672563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.672844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.673588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:29.673894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:29.675269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:29.686362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 504/999] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:29.687186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:29.792114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff12be-a283-4593-a15a-f16107609fe4 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:29.827392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:29.828144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.828435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.828714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.829478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] RBAC: Adding query filter params (interface=public, service_id=ced1f76db05842ddb92de502935fa75b, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:29.829793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:29.831162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0d27c-084f-46d7-9d3c-cb5422003679 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:29.841615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 496/1000] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:29 2022] GET /identity/v3/endpoints?service_id=ced1f76db05842ddb92de502935fa75b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:29.842718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:29.947381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7adb-e781-488c-8019-b8ca7f560202 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:29.982109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7a004-0846-45fe-b2e2-8ead2b81fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:29.982737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7a004-0846-45fe-b2e2-8ead2b81fa56 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:29.983025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7a004-0846-45fe-b2e2-8ead2b81fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:29.983306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7a004-0846-45fe-b2e2-8ead2b81fa56 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:29.983999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7a004-0846-45fe-b2e2-8ead2b81fa56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:29.985393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7a004-0846-45fe-b2e2-8ead2b81fa56 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:30.000040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 505/1001] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:29 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:35:30.224096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e60f-e188-460d-9818-8014c4dbabb4 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:30.224437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e60f-e188-460d-9818-8014c4dbabb4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:30.224660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e60f-e188-460d-9818-8014c4dbabb4 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:30.226300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 497/1002] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:30.231535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad6167-6461-437f-93cd-22640849b322 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:30.231869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad6167-6461-437f-93cd-22640849b322 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:30.232155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad6167-6461-437f-93cd-22640849b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:30.251256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9cad6167-6461-437f-93cd-22640849b322 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:30.252530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9cad6167-6461-437f-93cd-22640849b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:30.274365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:30.333897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 506/1003] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:30.356601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44e60f-e188-460d-9818-8014c4dbabb4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:30.360595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:30.465085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44e60f-e188-460d-9818-8014c4dbabb4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:30.501061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:30.501627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:30.501914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:30.502215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:30.502850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:30.504330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:30.513436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:30.514471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:35:30.515315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:30.523321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 498/1004] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 25 22:35:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:30.523596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad6167-6461-437f-93cd-22640849b322 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:30.624247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad6167-6461-437f-93cd-22640849b322 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:30.658142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:30.659011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:30.659291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:30.659564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:30.660275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:30.660580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:30.661951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:30.672316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 507/1005] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:30.673253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:30.743124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:30.778305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f1fb-76fa-447b-8af1-3f4147a5872a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:30.813212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:30.813825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:30.814105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:30.814378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:30.815056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:30.815378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:30.816764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f564fc9-520b-4f43-8197-955900d99ec2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:30.826294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 499/1006] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 25 22:35:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:30.827372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:30.851302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:30.931604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291791-aaa4-4c56-b7af-2822ab68e2bc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:30.966442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0bb3b-67e4-49cb-8c83-013852742f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:30.967061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0bb3b-67e4-49cb-8c83-013852742f78 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:30.967343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0bb3b-67e4-49cb-8c83-013852742f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:30.967616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0bb3b-67e4-49cb-8c83-013852742f78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:30.968371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0bb3b-67e4-49cb-8c83-013852742f78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:30.969726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0bb3b-67e4-49cb-8c83-013852742f78 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:31.067866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 508/1007] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:31.076434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eddfa-2fb3-478e-9d65-69f68b07755c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:31.076723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eddfa-2fb3-478e-9d65-69f68b07755c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:31.077004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137eddfa-2fb3-478e-9d65-69f68b07755c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:31.078453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 500/1008] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:31.084318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1529-0123-4679-b645-9ccb288ff4d9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:31.084648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1529-0123-4679-b645-9ccb288ff4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:31.084937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1529-0123-4679-b645-9ccb288ff4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:31.106237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-17da1529-0123-4679-b645-9ccb288ff4d9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:31.107662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-17da1529-0123-4679-b645-9ccb288ff4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:31.192243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 509/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:31.216696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eddfa-2fb3-478e-9d65-69f68b07755c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:31.336517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137eddfa-2fb3-478e-9d65-69f68b07755c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:31.368313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:31.373479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4772f7c-ae01-4053-b918-7023bba4d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:31.374167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4772f7c-ae01-4053-b918-7023bba4d03b None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:31.374458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4772f7c-ae01-4053-b918-7023bba4d03b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:31.374738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4772f7c-ae01-4053-b918-7023bba4d03b None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:31.375437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4772f7c-ae01-4053-b918-7023bba4d03b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:31.376955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4772f7c-ae01-4053-b918-7023bba4d03b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:31.504934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 501/1010] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:31 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:35:32.055624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e432-4bdd-4cbe-9456-370555deadd7 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:32.056462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e432-4bdd-4cbe-9456-370555deadd7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:32.056462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e432-4bdd-4cbe-9456-370555deadd7 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:32.058945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 510/1011] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:32.063413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:32.063870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:32.064005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:32.083434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:32.085364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:32.177608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 502/1012] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:32.202366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e432-4bdd-4cbe-9456-370555deadd7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:32.212758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:32.348185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e432-4bdd-4cbe-9456-370555deadd7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:32.394630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:32.395443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:32.396712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:32.397740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:32.398827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:32.402099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:32.418780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:32.420163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:35:32.421031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:32.422396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 511/1013] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:32.426061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:32.540294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78651-644c-4da7-bf41-b9e8704f3841 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:32.559270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:32.579937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:32.580575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:32.580864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:32.581145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:32.581843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] RBAC: Adding query filter params (name=compute) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:32.582149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:32.583529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:32.595270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 503/1014] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:32.596553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:32.675828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:32.710578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fd4f8-57e6-4191-b85d-a0ecf24529d9 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:32.746657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:32.747292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:32.747581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:32.747922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:32.748638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:32.748948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:32.750343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea622d-9c11-4614-874a-411170656a15 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:32.761354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 512/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 25 22:35:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:32.762659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:32.878887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98686b4-d2b9-4689-bc94-c15ef74a7f5e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:32.921167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330416-1d3b-441a-9a9b-c1840a01a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:32.921796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330416-1d3b-441a-9a9b-c1840a01a395 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:32.922139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330416-1d3b-441a-9a9b-c1840a01a395 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:32.922416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330416-1d3b-441a-9a9b-c1840a01a395 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:32.923148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330416-1d3b-441a-9a9b-c1840a01a395 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:32.924613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330416-1d3b-441a-9a9b-c1840a01a395 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:33.013014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 504/1016] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:33.245829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58a175-bc91-49f5-828d-3b8e688ef12d None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:33.245829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58a175-bc91-49f5-828d-3b8e688ef12d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:33.245829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58a175-bc91-49f5-828d-3b8e688ef12d None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:33.245829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 513/1017] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:33.251154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:33.251613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:33.251713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:33.270375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:33.271581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:33.312198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:33.363841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 505/1018] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:33.382362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58a175-bc91-49f5-828d-3b8e688ef12d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:33.490343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58a175-bc91-49f5-828d-3b8e688ef12d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:33.526265 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb85f0-107e-45f8-9446-1057df3c988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:33.526824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb85f0-107e-45f8-9446-1057df3c988e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:33.527116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb85f0-107e-45f8-9446-1057df3c988e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:33.527443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb85f0-107e-45f8-9446-1057df3c988e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:33.528634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb85f0-107e-45f8-9446-1057df3c988e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:33.530094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb85f0-107e-45f8-9446-1057df3c988e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:33.536683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 514/1019] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:33.538381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:33.646169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681d56-0d50-4bf9-ae66-fe1ca326ab99 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:33.682761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5848c24-f9fa-4605-89c5-b872770265ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:33.683722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5848c24-f9fa-4605-89c5-b872770265ce None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:33.684275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5848c24-f9fa-4605-89c5-b872770265ce None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:33.684740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5848c24-f9fa-4605-89c5-b872770265ce None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:33.685625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5848c24-f9fa-4605-89c5-b872770265ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:33.687246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5848c24-f9fa-4605-89c5-b872770265ce None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:33.797217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 506/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:33 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:33.817629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2802e-5192-4f27-9baf-4c8d51962f06 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:33.817910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2802e-5192-4f27-9baf-4c8d51962f06 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:33.818191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2802e-5192-4f27-9baf-4c8d51962f06 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:33.820903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 515/1021] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:33.826579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:33.826887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:33.827141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:33.846583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:33.847859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:33.861857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:33.926022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 507/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:33.950498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2802e-5192-4f27-9baf-4c8d51962f06 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:33.953486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:34.064021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2802e-5192-4f27-9baf-4c8d51962f06 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:34.100473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:34.101287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:34.101622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:34.101905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] PATH_INFO: `/v3/services/image` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:34.102590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:34.103964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:34.113395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:34.114389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:34.115298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 516/1023] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jul 25 22:35:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:34.123882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:34.228384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7334ba7-38d7-482f-a1a6-48311d0297a3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:34.265368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:34.266042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:34.266277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:34.266535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:34.267359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] RBAC: Adding query filter params (name=image) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:34.267588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:34.268974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:34.278961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 508/1024] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:34.283797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:34.359181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:34.393686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7ccc-573a-4bf7-9ee5-bce9dd44a293 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:34.431084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:34.431698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:34.432011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:34.432288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:34.433063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] RBAC: Adding query filter params (type=image) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:34.433305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:34.434669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:34.445363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 517/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:34.447337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:34.461032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:34.589750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76101d35-798e-477c-b7e4-4b61f4e1e428 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:34.626841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:34.627387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:34.627678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:34.627990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] PATH_INFO: `/v3/endpoints` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:34.628764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] RBAC: Adding query filter params (interface=public, service_id=0a4a63db60dd47c2ab83a8be6a44bc9b, region_id=RegionOne) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:34.629077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:34.630451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ad4b7-2b57-4506-ac8e-bb84218bbafe None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:34.641574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 509/1026] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:35:34 2022] GET /identity/v3/endpoints?service_id=0a4a63db60dd47c2ab83a8be6a44bc9b&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:34.642777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:34.748124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49adca-8b19-4e79-8c0c-2b72763c9610 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:34.777891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:34.784042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010acea0-7c1a-48a1-90e5-bcfa7f854253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:34.784658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010acea0-7c1a-48a1-90e5-bcfa7f854253 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:34.784941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010acea0-7c1a-48a1-90e5-bcfa7f854253 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:34.785210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010acea0-7c1a-48a1-90e5-bcfa7f854253 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:34.785866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010acea0-7c1a-48a1-90e5-bcfa7f854253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:34.787328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010acea0-7c1a-48a1-90e5-bcfa7f854253 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:34.794393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 518/1027] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:35:34 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:35:35.181496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2017e3-03b8-4ebf-93dd-1908000d1da0 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.181858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2017e3-03b8-4ebf-93dd-1908000d1da0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.182059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2017e3-03b8-4ebf-93dd-1908000d1da0 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.183470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 510/1028] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:35.188830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.189128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.189410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.208101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:35.211631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:35.285971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 519/1029] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:35.309975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2017e3-03b8-4ebf-93dd-1908000d1da0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:35.392069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:35.420485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2017e3-03b8-4ebf-93dd-1908000d1da0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:35.457035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:35.457664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.457949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.458226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.469079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:35.474092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:35.475136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:35.476393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:35.479931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 511/1030] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 25 22:35:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:35.481576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:35.587615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793ca8c-bab6-47c2-85d5-6d9fd4c6aff8 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:35.612114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:35.624146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:35.624778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.625638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.625638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.626078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:35.626387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:35.627809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:35.639791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 520/1031] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:35:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:35.642263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:35.747397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2a063-f7af-4dbc-ac05-a43358f413f8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:35.782289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:35.783553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.784098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.784585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.786917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:35.798371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:35.800245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-2dfd6638-0401-4fa4-a746-a901ef26caac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:35.815540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:35.816515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:35.817410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:35.817410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:35.817410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:35.817410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:35.818054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 512/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:35.824240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:35.932147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611141e-80e9-4bad-8988-b21ecf5e4ce1 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.932468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611141e-80e9-4bad-8988-b21ecf5e4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.932701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611141e-80e9-4bad-8988-b21ecf5e4ce1 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.934186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 513/1033] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:35.934760 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd40eb2-da61-45d1-bfe4-4af80ae8d89f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:35.938939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.939227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.939509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.960048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:35.961320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:35.972147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:35.972923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:35.973129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:35.973338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:35.974081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:35.974385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:35.976399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:35.991063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 521/1034] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:35.996558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.045086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 514/1035] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:36.049347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:36.071057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.106552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc66e26-ef44-4235-9cec-a1a2a4eb9dd7 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:36.144109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:36.144757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.145039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.145314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.153592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:36.155290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:36.168961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:36.169970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:36.171606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 522/1036] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:35:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:36.175914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.178076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ab22-ccef-4124-b220-b9043ee5adbe None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:36.195508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:36.214512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:36.215246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.215514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.215819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.216992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:36.218441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:36.220103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 515/1037] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:36.226769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.294340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49c5c-f47f-4acf-9ce6-a0367c8f609b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:36.305553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:36.335711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:36.336506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.337146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.337843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.339026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:36.340069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:36.341520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:36.355446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1bc4-c072-425d-838a-80d8c53fb2b8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:36.360841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 523/1038] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:35:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:36.366287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.397428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:36.398057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.398343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.398648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.399354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:36.400837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:36.471030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36bf03-959d-4e8d-a86f-c149a507b374 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:36.505092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0729-5e54-4095-90e2-96b4b9cc4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:36.505719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0729-5e54-4095-90e2-96b4b9cc4fac None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.506528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0729-5e54-4095-90e2-96b4b9cc4fac None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.506859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0729-5e54-4095-90e2-96b4b9cc4fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.521286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 516/1039] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:35:36 2022] POST /identity/v3/users => generated 285 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:35:36.551217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:36.595552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c0729-5e54-4095-90e2-96b4b9cc4fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:36.597115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c0729-5e54-4095-90e2-96b4b9cc4fac None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:36.712218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 524/1040] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:36.718148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.766501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:36.828442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c78df7-7e01-4324-8a0a-70f9d00f11b1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:36.838587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319423-f47b-4044-8934-88db42899484 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.838882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319423-f47b-4044-8934-88db42899484 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.839166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319423-f47b-4044-8934-88db42899484 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.840625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 525/1041] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:36.846533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.846909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.847474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.866191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:36.867475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:36.875500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:36.876197 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:36.876488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:36.876766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:36.897619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:36.899182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:36.914886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:36.916052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:36.916947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:36.916947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:36.916947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:36.916947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:36.920921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 517/1042] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:36.921764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:36.938351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:36.951958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 526/1043] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:36.972464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.026700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:37.036658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979ab29-cc10-4e5e-87e8-ee3200c6415b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.073495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.074130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.074809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.075441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.076862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:37.077176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.078607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.083006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192264b6-8120-46e8-bb06-06c30184ede9 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.096930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 518/1044] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:37.098371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.120967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.121937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.122385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.122836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] PATH_INFO: `/v3/services/image` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.127604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.127604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:37.134878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:37.136212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:37.137044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 527/1045] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jul 25 22:35:36 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:37.141891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.210792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:37.212437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aac8d-ae8b-42e0-99c0-2a854d199ed2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.248433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.249087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.249371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.249643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.257424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.258181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24139bbb-d858-4693-bb49-2f728ccfe420 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.258876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:37.270848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:37.272621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:37.273514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 519/1046] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:37.282831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.304808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:37.308252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.309421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.309705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.309982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.310680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] RBAC: Adding query filter params (name=image) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:37.310988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.312527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.319814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 528/1047] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:37.324294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.402085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d83fc-13f1-4c57-8adc-989ad9c99a04 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.433911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5afc99-70ab-4056-8dc9-39b6e353be74 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.445276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.446159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.446445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.446722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.447643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:37.447972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.450143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.457689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:37.467914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 520/1048] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:37.472215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.476517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.476958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.477302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.477641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.478335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] RBAC: Adding query filter params (type=image) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:37.478631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.480083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.489808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 529/1049] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:37.490945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:37.556582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:37.586573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b613547-3952-44e6-b446-478cfe00de11 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.607880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb129011-cfac-488d-920e-b771c594c5be None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:37.625957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.626693 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.627042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.627421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.628269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] RBAC: Adding query filter params (role.id=6a8e9bce321441f49dd66e8341032a2b, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=f27a1a3e92fa4293a57b8b4024d065b5) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:37.628583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.630016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334bae-3cee-465e-9451-6ca5f29b2b98 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.636402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 521/1050] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:37 2022] GET /identity/v3/role_assignments?user.id=f27a1a3e92fa4293a57b8b4024d065b5&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=6a8e9bce321441f49dd66e8341032a2b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:37.653633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6edf-03ff-4235-85a7-d5484c0ffb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:37.654310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6edf-03ff-4235-85a7-d5484c0ffb97 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:37.654668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6edf-03ff-4235-85a7-d5484c0ffb97 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:37.655050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6edf-03ff-4235-85a7-d5484c0ffb97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:37.655921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6edf-03ff-4235-85a7-d5484c0ffb97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:37.657416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6edf-03ff-4235-85a7-d5484c0ffb97 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:37.751797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 530/1051] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:35:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:38.652270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926719-cd70-41f0-b8bb-c71424c4137d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:38.652785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926719-cd70-41f0-b8bb-c71424c4137d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:38.652893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926719-cd70-41f0-b8bb-c71424c4137d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:38.654333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 522/1052] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:38.659698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:38.660145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:38.660372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:38.679612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:38.680845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:38.718047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:38.759563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 531/1053] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:38.782767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68926719-cd70-41f0-b8bb-c71424c4137d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:38.890072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68926719-cd70-41f0-b8bb-c71424c4137d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:38.928855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:38.929649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:38.929895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:38.930174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:38.932993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:38.941388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:38.947661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:38.948694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:38.949552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:38.952084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 523/1054] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:38.954809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:39.056800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64914ee3-0cca-41a5-9d39-ebd725aaf85f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:39.092213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:39.092828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.093109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.093380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.094091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:39.094393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:39.095742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:39.108671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 532/1055] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:39.110020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:39.214334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bc43a-6058-48f1-bd00-28511d4238fe None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:39.248764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:39.249413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.249694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.249968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] PATH_INFO: `/v3/users/8e297de3f2894e5cb632989b56c8f1f4` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.264101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] RBAC: Authorizing `identity:get_user(user_id=8e297de3f2894e5cb632989b56c8f1f4)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:39.265542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:39.272120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 524/1056] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:39 2022] GET /identity/v3/users/8e297de3f2894e5cb632989b56c8f1f4 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:39.273076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:39.310281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:39.381929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f346e85-158a-45c9-b5f9-3940650868be None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:39.415542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2634c3-abd1-4eaa-bf22-f1a5ef941757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:39.416204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2634c3-abd1-4eaa-bf22-f1a5ef941757 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.416488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2634c3-abd1-4eaa-bf22-f1a5ef941757 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.416763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2634c3-abd1-4eaa-bf22-f1a5ef941757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.484766 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2634c3-abd1-4eaa-bf22-f1a5ef941757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:39.486122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2634c3-abd1-4eaa-bf22-f1a5ef941757 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:39.516112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:39.594432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 533/1057] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:39.595944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:39.653364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:39.655658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f48a4-0404-426a-b871-a5e2caf81c0d None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.655989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f48a4-0404-426a-b871-a5e2caf81c0d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.656270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f48a4-0404-426a-b871-a5e2caf81c0d None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.657777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 534/1058] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:39.664043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.667809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.683264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:39.684490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:39.702314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265bdb7-91a1-4b51-a40e-3aab6b19d460 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:39.740776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:39.741554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.741845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.742120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.743294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] RBAC: Authorizing `identity:get_project(project_id=0965788d851a4058ad1612b4a05c7e3f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:39.744899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:39.751796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 525/1059] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:35:39 2022] GET /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:39.752874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:39.756151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 535/1060] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:39.778966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:39.842845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:39.859239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492a75-9d42-434f-801d-5f0c80961c46 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:39.881713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8ca5a-babb-4ed7-8eb0-783b5981d938 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:39.882054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:39.893557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:39.894174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.894459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.894737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.895528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=0965788d851a4058ad1612b4a05c7e3f, user.id=8e297de3f2894e5cb632989b56c8f1f4) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:39.895896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:39.897938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46f318-7487-452a-9e46-ae524e24b30f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:39.915872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 526/1061] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:39 2022] GET /identity/v3/role_assignments?user.id=8e297de3f2894e5cb632989b56c8f1f4&scope.project.id=0965788d851a4058ad1612b4a05c7e3f&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:39.915872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112aba-1549-4c72-bc6a-bdc7ad01f737 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.915872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112aba-1549-4c72-bc6a-bdc7ad01f737 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.915872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112aba-1549-4c72-bc6a-bdc7ad01f737 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.915872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 527/1062] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:39.915872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.916429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.916429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.920602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:39.921362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:39.921646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:39.921937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:39.934926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:39.936724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:39.938053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:39.940325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:39.941554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:39.942438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 536/1063] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 25 22:35:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:39.948236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.024887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 528/1064] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:40.048297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.064179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687b950-e94c-45ee-9bb7-331b79abcff6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.086202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:40.102857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.103484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.104253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.104635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.105828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:40.106143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.108067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.124013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 537/1065] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:35:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:40.125394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.169287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e60513-97a0-40fb-a94f-f4b8b7cf2615 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.188371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:40.207687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.208061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.208254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.208524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.244773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0429005-4940-4304-a6da-ae7d48133f23 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.282562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.284291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.291469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.292462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.292952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.293428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.308325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.309772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:40.324580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:40.325686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:40.326586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:40.326586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:40.326586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:40.326586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:40.326586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 538/1066] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:40.331368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.370614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:40.402676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 529/1067] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:40.408784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.427008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:40.449881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ebad-27ad-44f5-8751-59f6829e6271 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.486004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.486627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.486910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.487182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.487912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:40.488225 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.489606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.501878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 539/1068] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:40.507210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.525876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc24a8-b683-4c67-a0ab-aa26b7927497 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.564190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.565179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.565473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.565752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.576714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.578152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:40.594620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:40.595581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:40.596503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:40.596503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:40.596503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:40.596503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:40.596503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 530/1069] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:40.602581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.610801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:40.618708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b8df8-f91b-4608-a1c6-9a7ccee2dd9b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.660751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.661400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.661711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.662073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.669720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.671151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.679401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:40.683715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:40.688748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:40.689714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 540/1070] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:40.690656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:40.720029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5c224-84e2-418c-9b16-6ce617bb91fb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.754865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.755489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.756429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.756714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.757439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:40.757747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.759178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.771323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 531/1071] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:40.807544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c4f0-cc5d-4ba6-b5e6-3f4cb75c559e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:40.852979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:40.853903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:40.854336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:40.854759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:40.855779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:40.856250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:40.857905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:40.888695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 541/1072] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:40.890162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:41.002127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5e3f-c688-488d-a26a-da330f3e955b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:41.034998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:41.044602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:41.045262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.045581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.045863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.057557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:41.059022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:41.075858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:41.076949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:41.077874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:41.077874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:41.077874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:41.077874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:41.077874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 532/1073] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:41.083021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:41.098584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:41.185378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57257-e8aa-48f1-bc38-2a80c931f448 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:41.219732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:41.220374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.220660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.220939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.221684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:41.221991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:41.223370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:41.235060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 542/1074] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:41.240636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:41.359274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b39a-6b49-457a-9ae4-69c863a7ba90 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:41.392875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:41.393539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.393827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.394106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.401729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:41.403173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:41.415325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:41.416386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:41.417289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 533/1075] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:41.422596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:41.493014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:41.523527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bbdbf-b3b1-495f-8614-21f646688fc5 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:41.558207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:41.558877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.559163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.559492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.560235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:41.560545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:41.561991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acb1ff-0e7a-4263-b15a-40dbac4c1c6a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:41.574775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 543/1076] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:41.580772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:41.624749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:41.683646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27cc81-157b-40eb-8f80-73fd201d7d66 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:41.719114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d0512-7831-43c0-adee-3efb693a0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:41.719812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0512-7831-43c0-adee-3efb693a0c3e None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.720095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0512-7831-43c0-adee-3efb693a0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.720376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0512-7831-43c0-adee-3efb693a0c3e None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/f27a1a3e92fa4293a57b8b4024d065b5/roles/6a8e9bce321441f49dd66e8341032a2b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.722571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d0512-7831-43c0-adee-3efb693a0c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=f27a1a3e92fa4293a57b8b4024d065b5, role_id=6a8e9bce321441f49dd66e8341032a2b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:41.724038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d0512-7831-43c0-adee-3efb693a0c3e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:41.811388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 534/1077] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:41 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/f27a1a3e92fa4293a57b8b4024d065b5/roles/6a8e9bce321441f49dd66e8341032a2b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:41.919254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c126-1f22-4f9a-843f-b42eac0a20a2 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.919817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c126-1f22-4f9a-843f-b42eac0a20a2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.919817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c126-1f22-4f9a-843f-b42eac0a20a2 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.921250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 544/1078] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:41.926988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:41.927278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:41.928149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:41.948313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:41.949537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:42.021955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 535/1079] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:42.044486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c126-1f22-4f9a-843f-b42eac0a20a2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:42.149156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c126-1f22-4f9a-843f-b42eac0a20a2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:42.179278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:42.184125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:42.184759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:42.185041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:42.185314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:42.195947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:42.200813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:42.201934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:42.208024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 545/1080] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:42.210361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:42.241112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:42.311546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbac9ac-3abf-4d9e-a211-a2a82bbb59c5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:42.345716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:42.346337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:42.346622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:42.347030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:42.347668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:42.348004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:42.349905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:42.358308 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 536/1081] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:42.364193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:42.474212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b56d48-2ae1-4d32-a4a5-aea63062cd94 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:42.510385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:42.511029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:42.511317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:42.511593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] PATH_INFO: `/v3/users/8e297de3f2894e5cb632989b56c8f1f4` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:42.512875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] RBAC: Authorizing `identity:get_user(user_id=8e297de3f2894e5cb632989b56c8f1f4)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:42.514292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:42.515940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 546/1082] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:42 2022] GET /identity/v3/users/8e297de3f2894e5cb632989b56c8f1f4 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:42.521900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:42.614271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:42.624013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7472-f1f8-42ba-b102-c860d90a385a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:42.657132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d4d65-97e7-478c-83b1-69e6889212b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:42.657773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d4d65-97e7-478c-83b1-69e6889212b9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:42.658314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d4d65-97e7-478c-83b1-69e6889212b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:42.658595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d4d65-97e7-478c-83b1-69e6889212b9 None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:42.659859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d4d65-97e7-478c-83b1-69e6889212b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0965788d851a4058ad1612b4a05c7e3f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:42.661342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d4d65-97e7-478c-83b1-69e6889212b9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:42.663537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 537/1083] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:35:42 2022] GET /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:42.669511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:42.729413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:42.769169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fb0a-5f61-4409-8fcb-813e83a0fefb None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:42.805523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487202d6-7ef2-48de-b12f-3e40e61efc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:42.806191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487202d6-7ef2-48de-b12f-3e40e61efc9d None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:42.806476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487202d6-7ef2-48de-b12f-3e40e61efc9d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:42.806758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487202d6-7ef2-48de-b12f-3e40e61efc9d None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f/users/8e297de3f2894e5cb632989b56c8f1f4/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:42.808758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487202d6-7ef2-48de-b12f-3e40e61efc9d None admin] RBAC: Authorizing `identity:create_grant(project_id=0965788d851a4058ad1612b4a05c7e3f, user_id=8e297de3f2894e5cb632989b56c8f1f4, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:42.810204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487202d6-7ef2-48de-b12f-3e40e61efc9d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:42.880141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 547/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:42 2022] PUT /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f/users/8e297de3f2894e5cb632989b56c8f1f4/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:43.824699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db7dfa-f3cb-49d3-9ba7-f7033b39f887 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:43.825238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db7dfa-f3cb-49d3-9ba7-f7033b39f887 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:43.825238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db7dfa-f3cb-49d3-9ba7-f7033b39f887 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:43.826612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 538/1085] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:43.831976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:43.832603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:43.832603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:43.854165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:43.855370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:43.922623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 548/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:43.946017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db7dfa-f3cb-49d3-9ba7-f7033b39f887 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.049993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db7dfa-f3cb-49d3-9ba7-f7033b39f887 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:44.133542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:44.134185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.134465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.134741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.146099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:44.151022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:44.152048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:44.153070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 539/1087] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 25 22:35:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:44.158501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.207732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:44.256808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89140ef-283f-4dcf-9a3e-7b3d2b2f0c0d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:44.291940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:44.292563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.292843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.293116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.293834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:44.294145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:44.295498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:44.305795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 549/1088] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:35:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:44.311436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.334141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:44.414187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10294a9-ddaa-4eaa-ba91-33202286ffeb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:44.447309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:44.447988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.448273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.448547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.459818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:44.461257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:44.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:44.477026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:44.478112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:44.478112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:44.478112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:44.478112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:44.480065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 540/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:44.483139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.585882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc0a-e554-457f-9151-2c7148318051 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:44.598642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:44.620873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:44.621492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.621773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.622048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.622744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:44.623049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:44.624438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:44.636805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 550/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:44.642591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.719784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:44.751099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133cd6-b18e-4f10-93de-4d07ddae5d89 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:44.785177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:44.785811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.786095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.786370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.795460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:44.797180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-cecda565-1adc-4cc9-a4ff-a0d9ad9448a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:35:44.809569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:44.810559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:44.811917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 541/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 25 22:35:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:44.816892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.896762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6ceb4-5dc2-4036-a574-22898344e262 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.897328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6ceb4-5dc2-4036-a574-22898344e262 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.897328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6ceb4-5dc2-4036-a574-22898344e262 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.898651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 542/1092] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:44.903512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.903822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.904106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.922458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:44.923644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:44.924918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e89e-2c58-45d6-92d1-ea103c793a87 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:44.959533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:44.960189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:44.960475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:44.960753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:44.961558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:44.961869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:44.963292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:44.981179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 551/1093] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 25 22:35:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:44.986800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:44.995958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 543/1094] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:35:45.017158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.020066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.081791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.089896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdab4d-3ff5-4f74-8092-e4e491153968 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.119976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea621d-29a2-42e1-9344-7042841d8a29 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.125253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.125864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.126143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.126410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.155903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.156599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.156888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.157169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.168235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:35:45.173142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:45.174245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:35:45.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 544/1095] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:45.180211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.197777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.199401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.229540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.283104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c6843-5fa6-4755-b05e-fa8f0d64a78b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.301056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 552/1096] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:45.307125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.309767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.322017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.322639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.322924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.323195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.323939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:45.324245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.325603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.334605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 545/1097] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:45.340332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.409065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043726-195f-49c0-96ed-3c941d6eb60b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.437336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.443456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.444201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.444484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.444762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.445691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc937-75ed-44c8-8b67-cad044966136 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.454724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.456300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:35:45.471348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:45.472313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:45.473245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:35:45.473245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:35:45.473245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:35:45.473245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:45.473245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 553/1098] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:35:45.478277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.482347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.483138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.483471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.483812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] PATH_INFO: `/v3/users/8e297de3f2894e5cb632989b56c8f1f4` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.485181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] RBAC: Authorizing `identity:get_user(user_id=8e297de3f2894e5cb632989b56c8f1f4)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.486868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.489453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 546/1099] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/users/8e297de3f2894e5cb632989b56c8f1f4 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:45.494405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.548724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.588234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e766a51-da07-41fc-9e60-fedc7a040c06 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.599980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66a46-19e4-4c88-9551-cabaea6c586b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.622387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.623014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.623297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.623570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.624289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:45.624651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.626049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.633978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.634597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.634886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.635169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.638178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 554/1100] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:45.643906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.686252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.708415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.709985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.742916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5c357-6dbd-4a61-9526-02032750dcdf None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.761763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.777381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.778026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.778316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.778590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.785592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.787076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:35:45.799384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:35:45.800306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:35:45.801191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 555/1101] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:35:45.807042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.816501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 547/1102] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:35:45.817334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.905797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e54c-635f-47fe-9101-cf9920ef15da None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.907325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:45.917501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196e80c-4fa7-43ac-935a-3252bf82eb51 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:45.941320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.941997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.942286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.942729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.944016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:45.944320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.945755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.952100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:45.952762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:45.953046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:45.953322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:45.954490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] RBAC: Authorizing `identity:get_project(project_id=0965788d851a4058ad1612b4a05c7e3f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:45.955939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:45.957232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 556/1103] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:45.962323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 548/1104] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:35:45.963291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.963474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:45.984535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:46.067087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ca3ab-49ee-4d1b-9fa8-1e7b97e4a38a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:46.072830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c6b4b-b96a-484e-a394-e0de9e528887 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:46.103786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:46.104445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:46.104869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:46.105158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:46.105955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=0965788d851a4058ad1612b4a05c7e3f, user.id=8e297de3f2894e5cb632989b56c8f1f4) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:46.106270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:46.107752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a745d-f7b5-42bf-b12a-3939ce97f18a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:46.109795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:46.110422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:46.110700 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:46.110976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:46.111786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] RBAC: Adding query filter params (role.id=6a8e9bce321441f49dd66e8341032a2b, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=f27a1a3e92fa4293a57b8b4024d065b5) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:46.112108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:46.113510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b7e0-3fd1-45dd-ad95-8361906aeb3d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:46.113799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 549/1105] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/role_assignments?user.id=8e297de3f2894e5cb632989b56c8f1f4&scope.project.id=0965788d851a4058ad1612b4a05c7e3f&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:46.120553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 557/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:45 2022] GET /identity/v3/role_assignments?user.id=f27a1a3e92fa4293a57b8b4024d065b5&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=6a8e9bce321441f49dd66e8341032a2b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:48.175277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039d6d0-ebde-4998-9d78-4cfcaae321aa None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:48.175867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039d6d0-ebde-4998-9d78-4cfcaae321aa None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:48.175867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039d6d0-ebde-4998-9d78-4cfcaae321aa None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:48.177746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 550/1107] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:48.182820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:48.183209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:48.183375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:48.202082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:48.203307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:48.223400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:48.269881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 558/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:48.294694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039d6d0-ebde-4998-9d78-4cfcaae321aa None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:48.380323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:48.397767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039d6d0-ebde-4998-9d78-4cfcaae321aa None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:48.433618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1827a-bcf2-4c69-ba7a-d70bfae2fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:48.434166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1827a-bcf2-4c69-ba7a-d70bfae2fe9b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:48.434446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1827a-bcf2-4c69-ba7a-d70bfae2fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:48.434717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1827a-bcf2-4c69-ba7a-d70bfae2fe9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:48.435883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1827a-bcf2-4c69-ba7a-d70bfae2fe9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:48.437300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1827a-bcf2-4c69-ba7a-d70bfae2fe9b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:48.438922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 551/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:48.444999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:48.544245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700cf2-0324-4503-9ae3-07d64c595f42 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:48.577662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a374d0-8089-44b2-ba8b-78d284f7f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:48.578279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a374d0-8089-44b2-ba8b-78d284f7f3d6 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:48.578564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a374d0-8089-44b2-ba8b-78d284f7f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:48.578839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a374d0-8089-44b2-ba8b-78d284f7f3d6 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:48.579529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a374d0-8089-44b2-ba8b-78d284f7f3d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:48.580990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a374d0-8089-44b2-ba8b-78d284f7f3d6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:48.686013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 559/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:35:48 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:35:50.712095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169a9ee-59a9-496f-bc4b-dd0f69f74bfe None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:50.712692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169a9ee-59a9-496f-bc4b-dd0f69f74bfe None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:50.712692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169a9ee-59a9-496f-bc4b-dd0f69f74bfe None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:50.714016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 552/1111] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:50.719044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:50.719456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:50.719596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:50.737869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:50.739034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:50.746811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:50.804475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 560/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:50.828047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169a9ee-59a9-496f-bc4b-dd0f69f74bfe None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:50.944147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169a9ee-59a9-496f-bc4b-dd0f69f74bfe None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:50.979034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:50.979607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:50.979926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:50.980207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] PATH_INFO: `/v3/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:50.981660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] RBAC: Authorizing `identity:get_role(role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:50.983028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:50.984394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 553/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:50 2022] GET /identity/v3/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:50.990907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:51.089712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2867a-718d-4585-9418-6caa088e2107 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:51.125328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:51.125987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:51.126273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:51.126547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] PATH_INFO: `/v3/users/2be8d82d94804e688cbc54b9eebb905b` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:51.139447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:51.142037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] RBAC: Authorizing `identity:get_user(user_id=2be8d82d94804e688cbc54b9eebb905b)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:51.143490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:51.145245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 561/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:50 2022] GET /identity/v3/users/2be8d82d94804e688cbc54b9eebb905b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:51.151627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:51.174068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:51.249795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc12a-0b36-4849-8fcb-43c800f68f9d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:51.284174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:51.284817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:51.285105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:51.285385 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:51.353194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:51.354647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:51.374490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:51.452142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 554/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:35:51.457933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:51.554660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa48b2-523c-4131-a10b-6f97c4fe5213 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:51.588012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf081ebd-71cd-49a5-b483-93828d3b6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:51.588639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf081ebd-71cd-49a5-b483-93828d3b6797 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:51.588926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf081ebd-71cd-49a5-b483-93828d3b6797 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:51.589202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf081ebd-71cd-49a5-b483-93828d3b6797 None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:51.590353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf081ebd-71cd-49a5-b483-93828d3b6797 None admin] RBAC: Authorizing `identity:get_project(project_id=0965788d851a4058ad1612b4a05c7e3f)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:51.591792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf081ebd-71cd-49a5-b483-93828d3b6797 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:51.593446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 562/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:35:51 2022] GET /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:51.599499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:51.697524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07a125-a0e9-44d5-a628-dca2dfb284bf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:51.717067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:51.730507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:51.731118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:51.731404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:51.731684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:51.732506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] RBAC: Adding query filter params (role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=0965788d851a4058ad1612b4a05c7e3f, user.id=2be8d82d94804e688cbc54b9eebb905b) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:51.732827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:51.734261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ac8de-f80a-4a4f-b86d-4a6894bfa790 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:51.739485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 555/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:51 2022] GET /identity/v3/role_assignments?user.id=2be8d82d94804e688cbc54b9eebb905b&scope.project.id=0965788d851a4058ad1612b4a05c7e3f&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:53.736697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ec5a-90ae-4a0f-a8c1-134799a72372 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:53.737249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ec5a-90ae-4a0f-a8c1-134799a72372 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:53.737249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74ec5a-90ae-4a0f-a8c1-134799a72372 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:53.738615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 563/1118] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:53.744291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c468c4-5fee-442d-9266-958742606f45 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:53.744686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c468c4-5fee-442d-9266-958742606f45 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:53.744846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c468c4-5fee-442d-9266-958742606f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:53.763521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-58c468c4-5fee-442d-9266-958742606f45 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:53.764734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-58c468c4-5fee-442d-9266-958742606f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:53.839157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 556/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:53.862427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ec5a-90ae-4a0f-a8c1-134799a72372 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:53.932378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:53.967002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74ec5a-90ae-4a0f-a8c1-134799a72372 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:54.001461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:54.002019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:54.002307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:54.002587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] PATH_INFO: `/v3/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:54.004093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] RBAC: Authorizing `identity:get_role(role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:54.005634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:54.007079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 564/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:53 2022] GET /identity/v3/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:54.013056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c468c4-5fee-442d-9266-958742606f45 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:54.113120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c468c4-5fee-442d-9266-958742606f45 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:54.128011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:54.149540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:54.150199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:54.150487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:54.150770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] PATH_INFO: `/v3/users/2be8d82d94804e688cbc54b9eebb905b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:54.152013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] RBAC: Authorizing `identity:get_user(user_id=2be8d82d94804e688cbc54b9eebb905b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:54.153470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:54.155132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 557/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:54 2022] GET /identity/v3/users/2be8d82d94804e688cbc54b9eebb905b => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:54.161227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:54.260130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0461-9e10-48f1-8a47-1f8f4ad730a2 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:54.306993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f291b3-8adf-4cf0-8c5a-7a8aa7cfd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:54.307647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f291b3-8adf-4cf0-8c5a-7a8aa7cfd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:54.307968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f291b3-8adf-4cf0-8c5a-7a8aa7cfd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:54.308251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f291b3-8adf-4cf0-8c5a-7a8aa7cfd5a2 None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:54.309438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f291b3-8adf-4cf0-8c5a-7a8aa7cfd5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=0965788d851a4058ad1612b4a05c7e3f)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:54.310865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f291b3-8adf-4cf0-8c5a-7a8aa7cfd5a2 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:54.312601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 565/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:35:54 2022] GET /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:54.319551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:54.417414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03913a-c9fd-4e24-923a-fc99951c2037 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:54.450891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4bc56-aa0f-4be8-a874-2c2458f33fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:54.451549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4bc56-aa0f-4be8-a874-2c2458f33fa8 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:54.451869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4bc56-aa0f-4be8-a874-2c2458f33fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:54.452153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4bc56-aa0f-4be8-a874-2c2458f33fa8 None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f/users/2be8d82d94804e688cbc54b9eebb905b/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:54.454329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4bc56-aa0f-4be8-a874-2c2458f33fa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0965788d851a4058ad1612b4a05c7e3f, user_id=2be8d82d94804e688cbc54b9eebb905b, role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:54.455778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4bc56-aa0f-4be8-a874-2c2458f33fa8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:54.519368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 558/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:35:54 2022] PUT /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f/users/2be8d82d94804e688cbc54b9eebb905b/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:35:56.513623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808d73-c299-43fc-bf42-6c51a091f0b7 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:56.514168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808d73-c299-43fc-bf42-6c51a091f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:56.514168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808d73-c299-43fc-bf42-6c51a091f0b7 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:56.515527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 566/1124] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:35:56.520875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:56.521368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:56.521488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:56.539766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:56.541112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:56.580566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:56.612104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 559/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:56.636058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b808d73-c299-43fc-bf42-6c51a091f0b7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:56.640004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:56.741387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b808d73-c299-43fc-bf42-6c51a091f0b7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:56.776159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:56.776811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:56.777099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:56.777376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] PATH_INFO: `/v3/roles/c24a3d4c315b4b4cb063336f9d08b488` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:56.778839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] RBAC: Authorizing `identity:get_role(role_id=c24a3d4c315b4b4cb063336f9d08b488)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:56.780251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:56.781628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 567/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:56 2022] GET /identity/v3/roles/c24a3d4c315b4b4cb063336f9d08b488 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:56.788729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:56.891496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaf448-92cf-4584-a1c5-0f1391197fa8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:56.927219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:56.928723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:56.929010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:56.929287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] PATH_INFO: `/v3/users/2be8d82d94804e688cbc54b9eebb905b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:56.930601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] RBAC: Authorizing `identity:get_user(user_id=2be8d82d94804e688cbc54b9eebb905b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:56.932095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:56.933761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 560/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:35:56 2022] GET /identity/v3/users/2be8d82d94804e688cbc54b9eebb905b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:56.939562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:57.010729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:57.042667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe41f-9bbf-44b2-85db-6bcc09e7478f None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:57.077726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:57.078345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:57.078628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:57.078902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:57.148414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:57.149774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:57.219087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:57.251469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 568/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:35:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:35:57.257630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:57.301152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:57.362169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de515-bc30-4079-9f63-d6514610afe3 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:57.397581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c669905-4034-4f92-91eb-4af217ae3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:57.398224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c669905-4034-4f92-91eb-4af217ae3f99 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:57.398565 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c669905-4034-4f92-91eb-4af217ae3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:57.398796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c669905-4034-4f92-91eb-4af217ae3f99 None admin] PATH_INFO: `/v3/projects/0965788d851a4058ad1612b4a05c7e3f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:57.400011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c669905-4034-4f92-91eb-4af217ae3f99 None admin] RBAC: Authorizing `identity:get_project(project_id=0965788d851a4058ad1612b4a05c7e3f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:57.401465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c669905-4034-4f92-91eb-4af217ae3f99 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:57.403176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 561/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:35:57 2022] GET /identity/v3/projects/0965788d851a4058ad1612b4a05c7e3f => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:57.409823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:57.512210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3e16-6f70-4dbd-94e9-363ff7835eff None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:57.546892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:57.547583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:57.547817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:57.548102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:57.548908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] RBAC: Adding query filter params (role.id=c24a3d4c315b4b4cb063336f9d08b488, scope.project.id=0965788d851a4058ad1612b4a05c7e3f, user.id=2be8d82d94804e688cbc54b9eebb905b) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:35:57.549223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:57.550650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56cfd0-5e08-4119-a3d0-021413a3e5f1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:57.557450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 569/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:35:57 2022] GET /identity/v3/role_assignments?user.id=2be8d82d94804e688cbc54b9eebb905b&scope.project.id=0965788d851a4058ad1612b4a05c7e3f&role.id=c24a3d4c315b4b4cb063336f9d08b488 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:59.588309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247861-4384-4c7e-99f7-cff19533aaa3 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:59.588818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247861-4384-4c7e-99f7-cff19533aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:59.588818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af247861-4384-4c7e-99f7-cff19533aaa3 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:59.590130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 562/1131] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:35:59.595585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:59.596109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:59.596290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:59.614485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:35:59.616076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:35:59.648308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:59.688570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 570/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:35:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:35:59.714773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247861-4384-4c7e-99f7-cff19533aaa3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:59.820365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af247861-4384-4c7e-99f7-cff19533aaa3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:35:59.829892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:35:59.854826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08943f9-6498-4403-9eeb-5bcecc535a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:35:59.855464 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08943f9-6498-4403-9eeb-5bcecc535a2e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:35:59.855797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08943f9-6498-4403-9eeb-5bcecc535a2e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:35:59.856093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08943f9-6498-4403-9eeb-5bcecc535a2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:35:59.857549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08943f9-6498-4403-9eeb-5bcecc535a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:35:59.859275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08943f9-6498-4403-9eeb-5bcecc535a2e None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:35:59.860932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 563/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:35:59.867045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:35:59.968116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd77aba-e51e-4990-8351-b4ec075e7bec None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:00.002131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a910b-8e0d-48c0-b101-87c8ac4f8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:00.002749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a910b-8e0d-48c0-b101-87c8ac4f8574 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:00.003033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a910b-8e0d-48c0-b101-87c8ac4f8574 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:00.003307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a910b-8e0d-48c0-b101-87c8ac4f8574 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:00.004021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a910b-8e0d-48c0-b101-87c8ac4f8574 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:00.006223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a910b-8e0d-48c0-b101-87c8ac4f8574 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:00.104224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 571/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:35:59 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:36:02.150154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3fc7-d00f-4356-9b7e-2c72a575a236 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:02.150732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3fc7-d00f-4356-9b7e-2c72a575a236 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:02.150732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3fc7-d00f-4356-9b7e-2c72a575a236 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:02.152104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 564/1135] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:02.157553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:02.158258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:02.158375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:02.181533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:02.182728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:02.196201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:02.250664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 572/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:02.275767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3fc7-d00f-4356-9b7e-2c72a575a236 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:02.377286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3fc7-d00f-4356-9b7e-2c72a575a236 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:02.410824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9d93-254a-448a-9334-e20482ca6f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:02.411375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9d93-254a-448a-9334-e20482ca6f05 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:02.412399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9d93-254a-448a-9334-e20482ca6f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:02.412680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9d93-254a-448a-9334-e20482ca6f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:02.413840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f9d93-254a-448a-9334-e20482ca6f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:02.415271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f9d93-254a-448a-9334-e20482ca6f05 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:02.416906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 565/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:02.422753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:02.521038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a1947-dda4-4052-a7aa-a43827ec926d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:02.555419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc36ab-636f-47c4-b9a0-99b51dd6c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:02.556099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc36ab-636f-47c4-b9a0-99b51dd6c5c1 None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:02.556384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc36ab-636f-47c4-b9a0-99b51dd6c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:02.556663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc36ab-636f-47c4-b9a0-99b51dd6c5c1 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:02.557369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc36ab-636f-47c4-b9a0-99b51dd6c5c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:02.558866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc36ab-636f-47c4-b9a0-99b51dd6c5c1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:02.652176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 573/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:36:02 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:36:04.712667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df76dae-10d6-47dd-a722-997551396b4d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:04.713244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df76dae-10d6-47dd-a722-997551396b4d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:04.713244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df76dae-10d6-47dd-a722-997551396b4d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:04.714592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 566/1139] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:04.719800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:04.720227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:04.720347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:04.728216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:04.738942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:04.744864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:04.809685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 574/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:04.833295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df76dae-10d6-47dd-a722-997551396b4d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:04.881147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:04.936204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df76dae-10d6-47dd-a722-997551396b4d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:04.970608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:04.971170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:04.971457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:04.971738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:04.982034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:36:04.986904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:04.993277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:36:04.994440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 567/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:04.995350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:05.093537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a8b37-4ea2-4d9d-b53c-35970b8a0966 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:05.126940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33513d19-643d-4374-8123-dead61242396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:05.127566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33513d19-643d-4374-8123-dead61242396 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:05.127884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33513d19-643d-4374-8123-dead61242396 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:05.128169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33513d19-643d-4374-8123-dead61242396 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:05.128893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33513d19-643d-4374-8123-dead61242396 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:05.129202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33513d19-643d-4374-8123-dead61242396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:05.131144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33513d19-643d-4374-8123-dead61242396 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:05.132550 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:05.139738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 575/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:05.145676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:05.247827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48bd5f-fd43-4c69-8e2e-ea7c164db93e None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:05.250099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:05.282049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:05.282697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:05.283234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:05.283516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] PATH_INFO: `/v3/users/94dee357753d4bebbadbecc4e95ce858` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:05.297466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] RBAC: Authorizing `identity:get_user(user_id=94dee357753d4bebbadbecc4e95ce858)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:05.298934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:05.300710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 568/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:36:05 2022] GET /identity/v3/users/94dee357753d4bebbadbecc4e95ce858 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:05.307468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33513d19-643d-4374-8123-dead61242396 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:05.413830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33513d19-643d-4374-8123-dead61242396 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:05.446743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:05.447364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:05.447651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:05.447954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:05.508397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:05.514785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:05.516279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:05.614545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 576/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:36:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:36:05.620519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:05.719771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f0c3-5068-46f4-ba33-21f6067865c5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:05.756352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e04de-a6f6-4be9-8eec-9d28039882c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:05.756998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e04de-a6f6-4be9-8eec-9d28039882c8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:05.757286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e04de-a6f6-4be9-8eec-9d28039882c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:05.757568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e04de-a6f6-4be9-8eec-9d28039882c8 None admin] PATH_INFO: `/v3/projects/06985f7807ff491eaf43e4622f022129` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:05.758805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e04de-a6f6-4be9-8eec-9d28039882c8 None admin] RBAC: Authorizing `identity:get_project(project_id=06985f7807ff491eaf43e4622f022129)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:05.760224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e04de-a6f6-4be9-8eec-9d28039882c8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:05.761915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 569/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:36:05 2022] GET /identity/v3/projects/06985f7807ff491eaf43e4622f022129 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:05.768328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:05.860143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:05.866534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18c7c-d9ed-4238-a2e2-7b9fdda481dc None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:05.899814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:05.900440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:05.900726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:05.901004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:05.901806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=06985f7807ff491eaf43e4622f022129, user.id=94dee357753d4bebbadbecc4e95ce858) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:05.902117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:05.903557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7b1f-8f86-42a6-b97d-9ccffb8b26ea None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:05.909514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 577/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:36:05 2022] GET /identity/v3/role_assignments?user.id=94dee357753d4bebbadbecc4e95ce858&scope.project.id=06985f7807ff491eaf43e4622f022129&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:07.894921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294ac77-e4ce-4b91-9aa1-22fd42de628e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:07.895488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294ac77-e4ce-4b91-9aa1-22fd42de628e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:07.895593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294ac77-e4ce-4b91-9aa1-22fd42de628e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:07.897292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 570/1147] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:07.902609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:07.903002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:07.903163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:07.922269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:07.923472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:07.988360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 578/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:08.010865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294ac77-e4ce-4b91-9aa1-22fd42de628e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:08.041825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:08.115534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294ac77-e4ce-4b91-9aa1-22fd42de628e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:08.151109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:08.151670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:08.151980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:08.152256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:08.162954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:36:08.167797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:08.168853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:36:08.169970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 571/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:08.175021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:08.262519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:08.272472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38cb8b-dac3-481a-9e3c-0510c0d810a2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:08.307011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:08.307636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:08.307952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:08.308232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:08.308958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:08.309266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:08.310651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:08.319101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 579/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:08.324934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:08.419095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:08.429033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48c727-69b6-4829-9e79-d55c8c6b4078 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:08.464362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:08.465000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:08.465278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:08.465547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] PATH_INFO: `/v3/users/94dee357753d4bebbadbecc4e95ce858` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:08.466702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] RBAC: Authorizing `identity:get_user(user_id=94dee357753d4bebbadbecc4e95ce858)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:08.468170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:08.469781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 572/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:36:08 2022] GET /identity/v3/users/94dee357753d4bebbadbecc4e95ce858 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:08.475955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:08.575243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c2d0-c231-412f-b763-b530d7c14ea3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:08.608747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07c3e5-49e1-4afe-9cd5-9805c4884f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:08.609393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07c3e5-49e1-4afe-9cd5-9805c4884f0e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:08.609680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07c3e5-49e1-4afe-9cd5-9805c4884f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:08.609960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07c3e5-49e1-4afe-9cd5-9805c4884f0e None admin] PATH_INFO: `/v3/projects/06985f7807ff491eaf43e4622f022129` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:08.611119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07c3e5-49e1-4afe-9cd5-9805c4884f0e None admin] RBAC: Authorizing `identity:get_project(project_id=06985f7807ff491eaf43e4622f022129)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:08.612588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07c3e5-49e1-4afe-9cd5-9805c4884f0e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:08.614275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 580/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:36:08 2022] GET /identity/v3/projects/06985f7807ff491eaf43e4622f022129 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:08.620953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:08.721233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd436b-33cc-444f-b5cf-2deb4571588a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:08.755359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53ca62-cac4-4f32-b6b0-6a33affa6ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:08.756056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ca62-cac4-4f32-b6b0-6a33affa6ac6 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:08.756340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ca62-cac4-4f32-b6b0-6a33affa6ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:08.756614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ca62-cac4-4f32-b6b0-6a33affa6ac6 None admin] PATH_INFO: `/v3/projects/06985f7807ff491eaf43e4622f022129/users/94dee357753d4bebbadbecc4e95ce858/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:08.758555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53ca62-cac4-4f32-b6b0-6a33affa6ac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=06985f7807ff491eaf43e4622f022129, user_id=94dee357753d4bebbadbecc4e95ce858, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:08.760018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53ca62-cac4-4f32-b6b0-6a33affa6ac6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:08.845954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 573/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:36:08 2022] PUT /identity/v3/projects/06985f7807ff491eaf43e4622f022129/users/94dee357753d4bebbadbecc4e95ce858/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:36:10.824868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96cf2a-1262-4847-b325-68be2faa8071 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:10.825432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96cf2a-1262-4847-b325-68be2faa8071 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:10.825432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96cf2a-1262-4847-b325-68be2faa8071 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:10.826789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 581/1154] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:10.831882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:10.832273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:10.832448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:10.850847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:10.852066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:10.865592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:10.919357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 574/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:10.943916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96cf2a-1262-4847-b325-68be2faa8071 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:10.966367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:11.044477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96cf2a-1262-4847-b325-68be2faa8071 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:11.077588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:11.078152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:11.078432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:11.078705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:11.089740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:36:11.094622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:11.095899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:36:11.096949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 582/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:11.102207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:11.200380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38e02-bc15-4f4e-bb47-f85fc7b86dc1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:11.233553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:11.234156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:11.234436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:11.234707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:11.235420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:11.235723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:11.237108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:11.246059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 575/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:11.251930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:11.333476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:11.351923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256e451-425d-4d91-a58e-b2be050e867c None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:11.389347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:11.390004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:11.390293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:11.390575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] PATH_INFO: `/v3/users/94dee357753d4bebbadbecc4e95ce858` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:11.391817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] RBAC: Authorizing `identity:get_user(user_id=94dee357753d4bebbadbecc4e95ce858)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:11.393296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:11.394985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 583/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:36:11 2022] GET /identity/v3/users/94dee357753d4bebbadbecc4e95ce858 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:11.401795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:11.416027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:11.510199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493024f4-b44d-4480-9392-3477dd3442fb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:11.543432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:11.544075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:11.544356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:11.544627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:11.616408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:11.617853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:11.628980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:11.715989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 576/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:36:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:36:11.722089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:11.825729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e492a-e14d-4f22-9770-8a97b620ccdd None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:11.859674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8d646-4494-4f95-82f1-04e7a2e88920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:11.860344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d646-4494-4f95-82f1-04e7a2e88920 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:11.860625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d646-4494-4f95-82f1-04e7a2e88920 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:11.860899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d646-4494-4f95-82f1-04e7a2e88920 None admin] PATH_INFO: `/v3/projects/06985f7807ff491eaf43e4622f022129` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:11.862044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8d646-4494-4f95-82f1-04e7a2e88920 None admin] RBAC: Authorizing `identity:get_project(project_id=06985f7807ff491eaf43e4622f022129)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:11.863480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8d646-4494-4f95-82f1-04e7a2e88920 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:11.865651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 584/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:36:11 2022] GET /identity/v3/projects/06985f7807ff491eaf43e4622f022129 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:11.871874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:11.971219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb25d-bc6d-44b7-a67b-a30fa8d9a444 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:11.982755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:12.007014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:12.007646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:12.007959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:12.008263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:12.009073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=06985f7807ff491eaf43e4622f022129, user.id=94dee357753d4bebbadbecc4e95ce858) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:12.009379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:12.010828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572463c1-4b43-4281-85b6-aa7769f54bba None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:12.017529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 577/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:36:11 2022] GET /identity/v3/role_assignments?user.id=94dee357753d4bebbadbecc4e95ce858&scope.project.id=06985f7807ff491eaf43e4622f022129&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:14.066278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea666c-303c-44ab-9791-8b857099b96e None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:14.066810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea666c-303c-44ab-9791-8b857099b96e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:14.066904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea666c-303c-44ab-9791-8b857099b96e None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:14.068438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 585/1162] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:14.073738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:14.074123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:14.074293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:14.092483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:14.093683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:14.161130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 578/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:14.184077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea666c-303c-44ab-9791-8b857099b96e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:14.202510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:14.285113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea666c-303c-44ab-9791-8b857099b96e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:14.319183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:14.319728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:14.320048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:14.320327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:14.386005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:14.387455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:14.404818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:14.485820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 586/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:36:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:36:14.492600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:14.589541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd913e0-9553-4b0a-a81c-a4a6fe8554f6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:14.591698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:14.623577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:14.624247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:14.624535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:14.624812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:14.631585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:14.633217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ac257010-610c-4c8d-b0a5-af2266cc678c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:14.644990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:14.646223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:36:14.647548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 579/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:36:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:14.652318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:14.751582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4c86-5342-494f-9ab1-7aafae4634d1 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:14.768123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:14.785727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:14.789347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:14.789347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:14.789347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:14.789347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:14.789347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:14.791554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8d87-a627-4f21-8e79-c55468e2f431 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:14.797026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 587/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 25 22:36:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:36:16.807744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c70d-9324-44c7-9969-d337d8bda752 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:16.808330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c70d-9324-44c7-9969-d337d8bda752 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:16.808330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c70d-9324-44c7-9969-d337d8bda752 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:16.809704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 580/1167] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:16.814988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a049c-0232-496c-ac86-4d6add61af99 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:16.815419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a049c-0232-496c-ac86-4d6add61af99 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:16.815553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a049c-0232-496c-ac86-4d6add61af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:16.834096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ff6a049c-0232-496c-ac86-4d6add61af99 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:16.835295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ff6a049c-0232-496c-ac86-4d6add61af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:16.902423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 588/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:16.925866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439c70d-9324-44c7-9969-d337d8bda752 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:17.032987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439c70d-9324-44c7-9969-d337d8bda752 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:17.071353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8129d44-6ab2-4180-b25f-9bb950035aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:17.071929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129d44-6ab2-4180-b25f-9bb950035aa3 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:17.072219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129d44-6ab2-4180-b25f-9bb950035aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:17.072495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129d44-6ab2-4180-b25f-9bb950035aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:17.073218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8129d44-6ab2-4180-b25f-9bb950035aa3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:17.074599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8129d44-6ab2-4180-b25f-9bb950035aa3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:17.151928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 581/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Mon Jul 25 22:36:16 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:36:19.206895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48281-388e-47b8-8203-7dee5f2f1c11 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:19.207457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48281-388e-47b8-8203-7dee5f2f1c11 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:19.207457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48281-388e-47b8-8203-7dee5f2f1c11 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:19.209234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 589/1170] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:19.214512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:19.214946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:19.215075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:19.233470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:19.234669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:19.252370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:19.303273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 582/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:19.325956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a48281-388e-47b8-8203-7dee5f2f1c11 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:19.426816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a48281-388e-47b8-8203-7dee5f2f1c11 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:19.438157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:19.461626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62380f6-d0a1-43f3-af7a-d9d811031b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:19.462208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62380f6-d0a1-43f3-af7a-d9d811031b30 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:19.462503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62380f6-d0a1-43f3-af7a-d9d811031b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:19.462784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62380f6-d0a1-43f3-af7a-d9d811031b30 None admin] PATH_INFO: `/v3/domains/10091c0fa9dc4b339060f5a12ba60b12` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:19.473888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62380f6-d0a1-43f3-af7a-d9d811031b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=10091c0fa9dc4b339060f5a12ba60b12)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:19.475991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62380f6-d0a1-43f3-af7a-d9d811031b30 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:19.477692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 590/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Mon Jul 25 22:36:19 2022] GET /identity/v3/domains/10091c0fa9dc4b339060f5a12ba60b12 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:19.483719 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:19.581763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288f59c-06d7-4c35-867d-f3ccc1e0093e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:19.618071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070df9-c55c-4bdc-867b-311d3ab604db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:19.679235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070df9-c55c-4bdc-867b-311d3ab604db None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:19.679235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070df9-c55c-4bdc-867b-311d3ab604db None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:19.679235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070df9-c55c-4bdc-867b-311d3ab604db None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:19.679235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8070df9-c55c-4bdc-867b-311d3ab604db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:19.679235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8070df9-c55c-4bdc-867b-311d3ab604db None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:19.717250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 583/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:36:19 2022] POST /identity/v3/projects => generated 361 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:36:21.752539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fae1c-6e99-45b9-974a-ea8823d52322 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:21.753143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fae1c-6e99-45b9-974a-ea8823d52322 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:21.753143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fae1c-6e99-45b9-974a-ea8823d52322 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:21.754450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 591/1174] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:21.760204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:21.760634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:21.760760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:21.774176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:21.779467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:21.780690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:21.848695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 584/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:21.873522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fae1c-6e99-45b9-974a-ea8823d52322 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:21.981883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fae1c-6e99-45b9-974a-ea8823d52322 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:22.015605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b8a4d-b41f-4883-98db-523dc27d92e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:22.016209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b8a4d-b41f-4883-98db-523dc27d92e4 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:22.016496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b8a4d-b41f-4883-98db-523dc27d92e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:22.016774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b8a4d-b41f-4883-98db-523dc27d92e4 None admin] PATH_INFO: `/v3/domains/10091c0fa9dc4b339060f5a12ba60b12` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:22.017952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b8a4d-b41f-4883-98db-523dc27d92e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=10091c0fa9dc4b339060f5a12ba60b12)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:22.019402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b8a4d-b41f-4883-98db-523dc27d92e4 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:22.021110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 592/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Mon Jul 25 22:36:21 2022] GET /identity/v3/domains/10091c0fa9dc4b339060f5a12ba60b12 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:22.027219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:22.126304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5799f-d552-49b8-9ccb-3a201cbd2d8a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:22.163941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3910-f047-4770-b475-58083f743ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:22.164561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3910-f047-4770-b475-58083f743ad9 None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:22.164845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3910-f047-4770-b475-58083f743ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:22.165117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3910-f047-4770-b475-58083f743ad9 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:22.165809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3910-f047-4770-b475-58083f743ad9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:22.167243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3910-f047-4770-b475-58083f743ad9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:22.176074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:22.276035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 585/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:36:22 2022] POST /identity/v3/users => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:36:24.333285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc199ac-0ba4-4c41-ac64-86c581abe9d7 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:24.333974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc199ac-0ba4-4c41-ac64-86c581abe9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:24.333974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc199ac-0ba4-4c41-ac64-86c581abe9d7 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:24.335293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 593/1178] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:24.340594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:24.341011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:24.341162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:24.359702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:24.360953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:24.429041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 586/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:24.452065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc199ac-0ba4-4c41-ac64-86c581abe9d7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:24.493209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:24.556952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc199ac-0ba4-4c41-ac64-86c581abe9d7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:24.589931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:24.590575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:24.590882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:24.591161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:24.602331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:36:24.607261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:24.608485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:36:24.609565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 594/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:24.614568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:24.715264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4bf8-9134-40de-b26d-b120491abeff None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:24.739454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:24.751035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:24.751662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:24.751982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:24.752263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:24.752992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:24.753301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:24.754717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:24.763293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 587/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:24.769183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:24.871241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:24.875128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6f91c-3bd0-4d68-873f-3702d271db6d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:24.910739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:24.911396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:24.912258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:24.912540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] PATH_INFO: `/v3/users/4300d8c6f2954833a70a114dd4c9b033` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:24.926763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] RBAC: Authorizing `identity:get_user(user_id=4300d8c6f2954833a70a114dd4c9b033)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:24.928413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:24.930147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 595/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:36:24 2022] GET /identity/v3/users/4300d8c6f2954833a70a114dd4c9b033 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:24.936069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:25.039875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258779-1d9b-4fa1-82ae-7702c7d4c5c1 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:25.076773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:25.077417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:25.077712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:25.078012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:25.135283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:25.153089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:25.154621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:25.259427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 588/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:36:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:36:25.265481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:25.369180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d0cfc-5dd1-4d63-afcc-19844cf9b958 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:25.403534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8b22-3bc1-4665-ab14-3844f464bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:25.404118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8b22-3bc1-4665-ab14-3844f464bd5e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:25.404408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8b22-3bc1-4665-ab14-3844f464bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:25.404687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8b22-3bc1-4665-ab14-3844f464bd5e None admin] PATH_INFO: `/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:25.405850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8b22-3bc1-4665-ab14-3844f464bd5e None admin] RBAC: Authorizing `identity:get_project(project_id=5a9d8f064bf94b94a6f27dc371c6317c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:25.407315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8b22-3bc1-4665-ab14-3844f464bd5e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:25.409289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 596/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:36:25 2022] GET /identity/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:25.415569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:25.503309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:25.520038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2459e-27df-4eaa-850a-bbed5581123a None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:25.555362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:25.556014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:25.556296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:25.556571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:25.557366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=5a9d8f064bf94b94a6f27dc371c6317c, user.id=4300d8c6f2954833a70a114dd4c9b033) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:25.557682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:25.559115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea702e-ad3b-4dbd-af19-49d3c63b7bc3 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:25.565116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 589/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:36:25 2022] GET /identity/v3/role_assignments?user.id=4300d8c6f2954833a70a114dd4c9b033&scope.project.id=5a9d8f064bf94b94a6f27dc371c6317c&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:27.570990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea13c-ee18-409a-8e6e-3544b4364fc5 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:27.571510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea13c-ee18-409a-8e6e-3544b4364fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:27.571510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea13c-ee18-409a-8e6e-3544b4364fc5 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:27.572889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 597/1186] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:27.578322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:27.578752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:27.578868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:27.597747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:27.599472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:27.669390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 590/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:27.692403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea13c-ee18-409a-8e6e-3544b4364fc5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:27.717941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:27.795908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea13c-ee18-409a-8e6e-3544b4364fc5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:27.830546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:27.831114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:27.831401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:27.831678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:27.843100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:36:27.848123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:27.849252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:36:27.850478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 598/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:27.855432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:27.933455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:27.955276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b17d3-87e0-4f28-8baa-b06c26238ddf None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:27.989237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:27.990403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:27.990688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:27.991006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:27.991732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:27.992073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:27.993447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:28.001822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 591/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:28.008316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:28.092941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:28.108763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d299ba-cf94-4405-872b-05e1b0461e85 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:28.142282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:28.142912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:28.143195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:28.143466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] PATH_INFO: `/v3/users/4300d8c6f2954833a70a114dd4c9b033` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:28.144680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] RBAC: Authorizing `identity:get_user(user_id=4300d8c6f2954833a70a114dd4c9b033)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:28.146127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:28.147727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 599/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:36:28 2022] GET /identity/v3/users/4300d8c6f2954833a70a114dd4c9b033 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:28.153592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:28.255094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c05b4-e85d-4a02-b4e3-e31c76dce237 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:28.289787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67727cf5-e582-4480-a14e-4ebdf360df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:28.290437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67727cf5-e582-4480-a14e-4ebdf360df58 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:28.290723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67727cf5-e582-4480-a14e-4ebdf360df58 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:28.291001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67727cf5-e582-4480-a14e-4ebdf360df58 None admin] PATH_INFO: `/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:28.292195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67727cf5-e582-4480-a14e-4ebdf360df58 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9d8f064bf94b94a6f27dc371c6317c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:28.293643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67727cf5-e582-4480-a14e-4ebdf360df58 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:28.295380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 592/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:36:28 2022] GET /identity/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:28.301442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:28.401137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175ebe0-210f-4712-9a64-017a21b8e573 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:28.435704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cc0d0-be39-4309-9cd1-1b34d66ce895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:28.436406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc0d0-be39-4309-9cd1-1b34d66ce895 None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:28.436694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc0d0-be39-4309-9cd1-1b34d66ce895 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:28.436974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc0d0-be39-4309-9cd1-1b34d66ce895 None admin] PATH_INFO: `/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c/users/4300d8c6f2954833a70a114dd4c9b033/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:28.438928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cc0d0-be39-4309-9cd1-1b34d66ce895 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a9d8f064bf94b94a6f27dc371c6317c, user_id=4300d8c6f2954833a70a114dd4c9b033, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:28.440403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cc0d0-be39-4309-9cd1-1b34d66ce895 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:28.521807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 600/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:36:28 2022] PUT /identity/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c/users/4300d8c6f2954833a70a114dd4c9b033/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:36:30.499085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54514-8d3b-4221-97dd-3e10f0111e96 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:30.499612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54514-8d3b-4221-97dd-3e10f0111e96 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:30.499716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54514-8d3b-4221-97dd-3e10f0111e96 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:30.501150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 593/1193] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:36:30.506978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:30.507413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:30.507531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:30.526057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:36:30.527276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:36:30.534647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:30.595627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 601/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:36:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:36:30.618470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e54514-8d3b-4221-97dd-3e10f0111e96 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:30.629778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:30.720703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e54514-8d3b-4221-97dd-3e10f0111e96 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:30.753397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:30.754027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:30.754313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:30.754591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:30.765598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:36:30.770424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:36:30.772040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:36:30.772917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 594/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:36:30.778235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:30.875948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179420ce-8ce6-4628-896a-f753e349cf8f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:30.909327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:30.909946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:30.910233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:30.910511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:30.911238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:30.912185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:30.913554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:30.921674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 602/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:30.927735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:30.993855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:31.027380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bdf08-80ba-416e-89aa-6ef3ca4390cf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:31.061206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:31.061856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:31.062141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:31.062420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] PATH_INFO: `/v3/users/4300d8c6f2954833a70a114dd4c9b033` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:31.063590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=4300d8c6f2954833a70a114dd4c9b033)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:31.065052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:31.066688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 595/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 25 22:36:30 2022] GET /identity/v3/users/4300d8c6f2954833a70a114dd4c9b033 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:31.073334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:31.077097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:31.172754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014409-30cc-4c0f-9efc-8c9c9352e88e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:31.205045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:31.205661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:31.205941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:31.206213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:31.271725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:31.273190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:31.275682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:31.370166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 603/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:36:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:36:31.376098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:31.474707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e16d9-51f0-4899-beba-6253ac7b4ec0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:31.507943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdba1c-d8cf-464b-b62c-ea2e9f567dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:31.508609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdba1c-d8cf-464b-b62c-ea2e9f567dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:31.508846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdba1c-d8cf-464b-b62c-ea2e9f567dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:31.509119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdba1c-d8cf-464b-b62c-ea2e9f567dd4 None admin] PATH_INFO: `/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:31.510268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdba1c-d8cf-464b-b62c-ea2e9f567dd4 None admin] RBAC: Authorizing `identity:get_project(project_id=5a9d8f064bf94b94a6f27dc371c6317c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:31.511685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdba1c-d8cf-464b-b62c-ea2e9f567dd4 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:31.513379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 596/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 25 22:36:31 2022] GET /identity/v3/projects/5a9d8f064bf94b94a6f27dc371c6317c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:31.519505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:36:31.617372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf7bf-81f7-465c-b575-e8a9495b5a36 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:36:31.619647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:31.650035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:36:31.650641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:36:31.650933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:36:31.651416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:36:31.652394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=5a9d8f064bf94b94a6f27dc371c6317c, user.id=4300d8c6f2954833a70a114dd4c9b033) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:36:31.652758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:36:31.654436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ac881-95a7-4a81-8394-4d2bef1b03eb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:36:31.660342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 604/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:36:31 2022] GET /identity/v3/role_assignments?user.id=4300d8c6f2954833a70a114dd4c9b033&scope.project.id=5a9d8f064bf94b94a6f27dc371c6317c&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:36:41.503012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:36:41.657485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=16 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:42.833526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fefc1-dbfa-4932-a6c9-af5fef915d74 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:42.834155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fefc1-dbfa-4932-a6c9-af5fef915d74 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:42.834155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fefc1-dbfa-4932-a6c9-af5fef915d74 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:42.835431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 597/1201] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:37:42.840732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:42.841159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:42.841298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:42.860219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:37:42.861429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:37:42.930435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 605/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:37:42.955024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fefc1-dbfa-4932-a6c9-af5fef915d74 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:43.059356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fefc1-dbfa-4932-a6c9-af5fef915d74 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:43.093425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:43.093999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:43.094289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:43.094570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:43.105645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:43.107092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:43.122107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:43.126315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:43.127556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:43.127556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:43.127556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:43.127556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:43.127556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 598/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:43.129415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:43.226751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6dc9-9bbd-40d4-9631-964aff892b45 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:43.255420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:43.261162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:43.263854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:43.263854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:43.263854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:43.263854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:43.263854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:43.264655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e8c37-14b0-48da-b863-31563b6559c6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:43.276406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 606/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:43.282334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:43.338171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:43.383871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d974-8f7a-42e3-ab36-5303ff25d4d7 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:43.418288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efbae-8858-4171-b163-97740feaeeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:43.418945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efbae-8858-4171-b163-97740feaeeec None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:43.419234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efbae-8858-4171-b163-97740feaeeec None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:43.419513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efbae-8858-4171-b163-97740feaeeec None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:43.420251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6efbae-8858-4171-b163-97740feaeeec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:43.421692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6efbae-8858-4171-b163-97740feaeeec None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:43.522563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 599/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 25 22:37:43 2022] POST /identity/v3/users => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:37:45.569400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedc479-e158-4630-8e54-6275ce017a9a None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:45.569936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedc479-e158-4630-8e54-6275ce017a9a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:45.569936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedc479-e158-4630-8e54-6275ce017a9a None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:45.571295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 607/1206] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:37:45.580279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:45.580741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:45.580860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:45.600127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:37:45.601348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:37:45.675109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 600/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:37:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:37:45.699988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedc479-e158-4630-8e54-6275ce017a9a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:45.806134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedc479-e158-4630-8e54-6275ce017a9a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:45.840528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:45.841100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:45.841391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:45.841673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:45.853121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:37:45.858126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:45.859493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:45.860425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 608/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:37:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:45.865757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:45.908770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:45.978854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b387-8e73-4a50-8742-2ad11edfdb85 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:46.013542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:46.014171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:46.014453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:46.014754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:46.015471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:46.015797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:46.017215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:46.025931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 601/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:46.032688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:46.086617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:46.137283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb815cbe-8251-44bd-942d-41f4bebe5b68 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:46.171813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:46.172476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:46.173052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:46.175831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:46.186867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:46.188369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:46.203166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:46.204300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:46.205235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:46.205235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:46.205235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:46.205235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:46.205235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 609/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:46.210806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:46.316192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:46.319782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9531023-3328-4c95-9d06-c30341fc4608 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:46.354539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:46.355185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:46.355468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:46.355751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:46.356479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:46.356788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:46.358195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:46.370526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 602/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:46.376361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:46.481207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0448-d334-4733-9cb1-c0be52644c88 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:46.482716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:46.518424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:46.519069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:46.519355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:46.519631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:46.529064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:46.530497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:37:46.542604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:46.543885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:46.544898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 610/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:37:46.550375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:46.656197 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c5b1-6092-4339-a6e6-1280191003bf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:46.693057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:46.693714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:46.694002 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:46.694279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:46.695116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:46.695423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:46.696900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:46.714656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 603/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 25 22:37:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:46.720628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:46.824824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736667b6-4000-4c12-bfed-aed997c3dd2a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:46.864526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:46.865159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:46.865444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:46.865724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:46.896193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:46.935987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:46.937516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:47.040449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 611/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:37:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:37:47.046394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:47.069844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:47.157644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02398-26cd-4ce2-8204-92715db1ee51 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:47.196311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:47.196960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:47.197249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:47.197528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:47.212980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:47.214458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:47.229624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:47.230745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:47.231883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:47.231883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:47.231883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:47.231883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:47.231883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 604/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:47.236700 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:47.300071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:47.340288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fef3d9-166e-4c41-82ef-f50c384c7d71 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:47.375198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:47.375849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:47.376139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:47.376415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:47.377150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:47.377460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:47.379112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:47.392586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 612/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:47.398336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:47.472341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:47.505890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cdb53-da15-44d0-a190-162e9e69b2cf None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:47.541817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:47.542502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:47.542787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:47.543067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:47.550039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:47.552114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:37:47.563729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:47.564836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:47.565749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 605/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:47.571627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:47.682636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e8df-015d-4257-880d-6f6eca98fcb9 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:47.707713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:47.720237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:47.720866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:47.721421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:47.721421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:47.722174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:47.722542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:47.724494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943341-e0bf-42b1-befb-24bad5002298 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:47.737180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 613/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:37:47.745084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:47.848899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc9e68-c531-40db-a8f4-30df68b51aa9 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:47.880347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:47.886280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:47.886966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:47.887257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:47.887536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:47.888371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=c508de5b7417417da87d702090178c8a) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:47.888683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:47.890189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af939e86-d08d-47eb-897e-3d0de2266981 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:47.896010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 606/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:37:47 2022] GET /identity/v3/role_assignments?user.id=c508de5b7417417da87d702090178c8a&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:49.900778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5d92b-b85b-4342-9395-b2e7ff2abc9b None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:49.901370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5d92b-b85b-4342-9395-b2e7ff2abc9b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:49.901370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5d92b-b85b-4342-9395-b2e7ff2abc9b None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:49.902735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 614/1220] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:37:49.908191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:49.908652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:49.908743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:49.928138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:37:49.929351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:37:49.999735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 607/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:37:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:37:50.022227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5d92b-b85b-4342-9395-b2e7ff2abc9b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:50.130440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5d92b-b85b-4342-9395-b2e7ff2abc9b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:50.166507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:50.167066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:50.167352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:50.167626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:50.178522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:37:50.183349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:50.186972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:50.188059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 615/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:50.190786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:50.297226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdfd24-f007-402f-9139-0f96a2db6c93 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:50.322902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:50.333854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:50.334483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:50.334768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:50.335044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:50.335877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] RBAC: Adding query filter params (name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:50.336188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:50.337571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:50.345662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 608/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:50.352015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:50.398464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:50.453724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c73ae-e27b-4628-9b19-4cd9725ab812 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:50.486121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:50.486940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:50.487398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:50.488250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:50.498956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:50.500432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:50.515319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:50.516481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:50.517613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:50.517613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:50.517613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:50.517613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:50.517613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 616/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:50.522441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:50.624378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd6fda-6489-4284-a8a5-dfa100c4f6cb None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:50.657684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:50.658301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:50.658584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:50.659109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:50.659829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:50.660137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:50.662081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:50.674023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 609/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:50.680835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:50.775542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:50.782044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7075f-9a3c-4511-a914-a2aefd796fb6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:50.816162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:50.816848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:50.817336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:50.817624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:50.825410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:50.827978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:37:50.838316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:50.839512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:50.840807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 617/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:50.845823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:50.893295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:50.946494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4862-d867-4370-beb2-949b182d4ce2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:50.983581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:50.984254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:50.984540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:50.984816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:50.985632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:50.985942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:50.987394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:51.006433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 610/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 25 22:37:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:51.012438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:51.117949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3c39-8f14-43d0-871f-0f2672ca0a2d None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:51.152169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:51.152816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:51.153104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:51.153387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:51.164827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:51.166347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:51.181221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:51.182110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:51.183002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:51.183002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:51.183002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:51.183002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:51.183002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 618/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:51.188255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:51.292877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09477ad6-8c66-4773-be78-2f1fbf65b76d None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:51.295202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:51.328411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:51.329033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:51.329319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:51.329600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:51.330321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:51.330625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:51.332022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:51.343364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 611/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:51.349713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:51.359160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:51.448132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08e55-2eb0-4f2a-a96c-bf1b5d260961 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:51.481554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:51.482186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:51.482472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:51.482754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:51.491136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:51.498579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:37:51.504113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:51.505083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:51.506206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 619/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:51.511180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:51.613119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7de7-6186-434e-a9b8-7bb9192d53ed None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:51.647222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:51.647858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:51.648143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:51.648419 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:51.649175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:51.649485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:51.650915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e437a9b-b2ed-4c38-b691-37ea3a5c72cd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:51.663871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 612/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:37:51.670034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:51.737713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:51.772088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b103892-e4c0-4ffb-983a-34d9867ffda0 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:51.806695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c602a27-fe0f-4438-9c62-de9454cc95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:51.807406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c602a27-fe0f-4438-9c62-de9454cc95cb None admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:51.807696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c602a27-fe0f-4438-9c62-de9454cc95cb None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:51.808009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c602a27-fe0f-4438-9c62-de9454cc95cb None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/c508de5b7417417da87d702090178c8a/roles/998251f4d7ff440fa4d6612b68091be0` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:51.822736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c602a27-fe0f-4438-9c62-de9454cc95cb None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=c508de5b7417417da87d702090178c8a, role_id=998251f4d7ff440fa4d6612b68091be0)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:51.824292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c602a27-fe0f-4438-9c62-de9454cc95cb None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:51.937929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 620/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:37:51 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/c508de5b7417417da87d702090178c8a/roles/998251f4d7ff440fa4d6612b68091be0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:37:53.951966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1128-8955-45a3-8b13-672b54831d97 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:53.952580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1128-8955-45a3-8b13-672b54831d97 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:53.952580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1128-8955-45a3-8b13-672b54831d97 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:53.953878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 613/1233] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:37:53.960168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:53.960667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:53.960785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:53.979017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:37:53.980258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:37:54.047270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 621/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:37:54.071433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1128-8955-45a3-8b13-672b54831d97 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:54.096502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:54.173211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1128-8955-45a3-8b13-672b54831d97 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:54.211748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:54.212362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:54.212648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:54.212924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:54.223402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:37:54.228606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:54.229808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:54.230927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 614/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 25 22:37:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:54.236767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:54.284802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:54.338633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e971-d263-4f17-83dd-b4b0e538c42a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:54.373106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:54.373724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:54.374010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:54.374283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:54.375001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] RBAC: Adding query filter params (name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:54.375306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:54.376762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:54.384464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 622/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 25 22:37:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:54.390279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:54.474766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:54.490741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c8df3-3862-4de7-ab65-76c2c0a4ca86 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:54.523581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:54.524274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:54.524553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:54.524832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:54.536846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:54.538385 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:54.553342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:54.554555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:54.555673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:54.555673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:54.555673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:54.555673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:54.555673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 615/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:54.560456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:54.659880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c9b11-9c38-4237-b20e-34e6fcd20821 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:54.669358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:54.694207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:54.694824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:54.695106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:54.695381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:54.696105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:54.696410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:54.697761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:54.709851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 623/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:54.715911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:54.815698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca049d4-cac5-4437-aef4-53de4ac4c644 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:54.850011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:54.850652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:54.850970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:54.851251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:54.853950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:54.858896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:54.860376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:37:54.871916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:54.873039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:54.874557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 616/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:54.879065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:54.977682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37d68-8f79-47b0-882d-7b45953f9dab None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:55.011781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:55.012373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:55.012659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:55.012936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:55.013742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:55.014053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:55.015470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:55.034335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 624/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 25 22:37:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:55.041194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:55.159668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7206-5156-42fc-8b8f-08acf1dd7397 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:55.194969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:55.195583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:55.195898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:55.196178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:55.258052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:55.265313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:55.266798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:55.368220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 617/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:37:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:37:55.374091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:55.401954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:55.474936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2c5d-3aa8-4ff0-a119-e5ff7a6d7e09 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:55.508773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:55.509448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:55.509731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:55.510007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:55.520593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:55.522174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:55.538313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:55.542603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:55.543734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:55.543734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:55.543734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:55.543734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:55.543734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 625/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:55.545629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:55.647597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:55.653279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297e790-9eba-4f02-b882-f8807f66e309 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:55.687039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:55.687654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:55.687966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:55.688243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:55.688940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:55.689243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:55.690601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:55.701738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 618/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:55.708016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:55.786790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:55.807712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422a336-fb7c-4fe8-954b-c517823fbb1e None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:55.844115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:55.844764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:55.845048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:55.845324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:55.852314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:55.853768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:37:55.866014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:55.867196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:55.868380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 626/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:55.873201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:55.984524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69d1d-a14f-4cc0-bf66-f7e14cf8e6e8 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:56.018622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:56.019248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:56.019533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:56.019954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:56.021495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:56.021810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:56.023276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6dd73-bc0f-4ab5-bd9e-836547e173fc None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:56.035835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 619/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:56.042278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:56.146121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e47e7-5918-45c2-89dc-9504584fe432 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:56.181187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:56.181932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:56.182347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:56.182722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:56.183698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] RBAC: Adding query filter params (role.id=998251f4d7ff440fa4d6612b68091be0, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=c508de5b7417417da87d702090178c8a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:56.184136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:56.185749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2029-e5ba-485d-b319-8dbcf5eab443 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:56.192563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 627/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:37:56 2022] GET /identity/v3/role_assignments?user.id=c508de5b7417417da87d702090178c8a&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=998251f4d7ff440fa4d6612b68091be0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:58.307343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531233dd-f8c3-4569-b594-1ff776bce012 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:58.307856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531233dd-f8c3-4569-b594-1ff776bce012 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:58.307951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531233dd-f8c3-4569-b594-1ff776bce012 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:58.309311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 620/1247] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:37:58.314688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:58.315114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:58.315248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:58.321769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:58.334218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:37:58.335447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:37:58.403667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 628/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:37:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:37:58.428232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531233dd-f8c3-4569-b594-1ff776bce012 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:58.446470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:58.530723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531233dd-f8c3-4569-b594-1ff776bce012 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:58.565448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:58.566024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:58.566312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:58.566614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:58.577539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:37:58.582593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:58.583898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:58.585124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 621/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:58.589922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:58.691231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d0705-85b7-42ac-a407-199cbb4ca7b3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:58.721864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:58.727028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:58.727665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:58.727974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:58.728254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:58.729016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:58.729324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:58.730690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:58.739686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 629/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:37:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:58.745539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:58.828040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:58.851493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ec29-08df-4fd8-bb9e-a4892c6437de None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:58.885530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:58.886164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:58.886448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:58.886722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:58.896865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:58.898316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:58.915337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:58.916591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:58.917715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:58.917715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:58.917715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:58.917715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:58.917715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 622/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:58.922579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:59.023614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b24f2-5b12-425c-bcfd-bcf315b9b897 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:59.059253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:59.059912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:59.060201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:59.060474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:59.061168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:59.061472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:59.062958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:59.075303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 630/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:59.081373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:59.185607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ae7cb-b69d-42bb-8b6f-d65172f73141 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:59.212083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:59.220003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:59.220640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:59.220928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:59.221237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:59.228877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:59.230320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:37:59.241912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:59.243054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:37:59.249009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 623/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:59.249665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:59.306949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:59.353095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffb19a-f8ce-4cb7-a45c-072c05d2b166 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:59.386762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:59.387381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:59.387669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:59.387975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:59.388892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:37:59.389203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:59.390643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:59.410371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 631/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 25 22:37:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:37:59.416866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:59.517792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383cc4-c064-4361-8d3f-c8707978c180 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:59.552966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:59.553586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:59.553874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:59.554154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:59.610671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:59.623501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:59.625007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:59.728744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 624/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:37:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:37:59.734677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:59.838415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cbd12-fe40-4120-9837-b964623fefc3 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:37:59.851777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:37:59.872427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:37:59.873002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:37:59.873288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:37:59.873563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:37:59.884954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:37:59.886462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:37:59.901952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:37:59.903044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:37:59.904175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:37:59.904175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:37:59.904175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:37:59.904175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:37:59.904175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 632/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:37:59.909196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:37:59.998820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:00.011165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2f415-9d01-41ac-aba0-6c8f69666da6 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:00.045689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:00.046306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:00.046588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:00.046862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:00.047550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:00.047879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:00.049231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:00.061453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 625/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:00.067444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:00.167182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26467632-ad68-4212-9922-45c2de6251ba None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:00.200775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:00.201413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:00.201701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:00.201980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:00.209283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:00.210706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:38:00.221795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:00.222987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:00.224735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 633/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:00.229534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:00.331259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a2de-8f94-43b3-a697-787c64f6a19f None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:00.365113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:00.365752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:00.366042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:00.366323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:00.367080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:00.367390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:00.368891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72606b0b-f87a-4b30-b675-4ada65ac6acf None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:00.381699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 626/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:00.387952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:00.415277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:00.487693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56f5d2-d22a-42ac-9040-263622b19e50 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:00.521120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:00.521722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:00.522008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:00.522287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:00.523081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=c508de5b7417417da87d702090178c8a) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:00.523391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:00.524854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a086b-cb33-43be-aa31-5574863d0d42 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:00.530216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 634/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:00 2022] GET /identity/v3/role_assignments?user.id=c508de5b7417417da87d702090178c8a&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:02.557420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ba20-87a0-4298-acbc-c906a805a605 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:02.557963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ba20-87a0-4298-acbc-c906a805a605 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:02.557963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ba20-87a0-4298-acbc-c906a805a605 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:02.559279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 627/1261] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:02.564457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:02.564877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:02.565024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:02.583518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:02.584727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:02.650672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 635/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:38:02.673295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ba20-87a0-4298-acbc-c906a805a605 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:02.685030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:02.776358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ba20-87a0-4298-acbc-c906a805a605 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:02.811245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:02.811862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:02.812145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:02.812419 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:02.822469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:02.827292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:02.828424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:02.829560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 628/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:02.835016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:02.853850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:02.937658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dd115-0f62-43af-8016-8348d5b39196 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:02.972232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:02.973428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:02.973720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:02.973994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:02.974716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:02.975017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:02.976400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:02.984390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 636/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:02.991069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:03.058834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:03.092049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d37233-f62a-47c4-aee0-afc4d6408491 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:03.126718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:03.127357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:03.127642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:03.127945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:03.138688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:03.140173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:38:03.155064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:03.156182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:03.157298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:38:03.157298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:38:03.157298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:03.157298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:03.157298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 629/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:38:03.163256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:03.244360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:03.262859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c397d-bca4-487b-a4be-c6f05b82c3a6 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:03.296727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:03.297376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:03.297640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:03.297911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:03.298618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:03.298928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:03.300496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:03.312660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 637/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:03.319147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:03.421349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ec59a-41eb-482a-ba86-6b11997bcf5b None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:03.440591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:03.454763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:03.455529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:03.455850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:03.456135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:03.464429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:03.465871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:38:03.477009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:03.478233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:03.479251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 630/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:03.484258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:03.586358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fae0d-f6b0-4ffb-a947-bc6fe6886581 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:03.620105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:03.620724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:03.621012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:03.621288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:03.622089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:03.622404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:03.623854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:03.633180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:03.641469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 638/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 25 22:38:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:03.648255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:03.749980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1330-ba04-4cd2-bee9-a4ace0275683 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:03.783361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:03.784281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:03.785301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:03.785301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:03.795633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:03.797130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:38:03.811999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:03.813121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:03.814050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:38:03.814050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:38:03.814050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:03.814050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:03.814050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 631/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:03.819867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:03.920503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9428d-c84b-4585-b3a3-fcd26d483769 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:03.955372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:03.956018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:03.956307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:03.956622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:03.958128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:03.958441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:03.959885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:03.971106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 639/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:03.977834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:04.014087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:04.085425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9ebbb-c2c8-4548-a111-921563f87be2 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:04.121377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:04.122018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:04.122302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:04.122581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:04.129425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:04.130865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:38:04.142071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:04.146816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:04.147712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 632/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:04.149457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:04.210675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:04.252538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de46ee6-31d6-4683-9c7e-4af10435ac54 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:04.287621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:04.288200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:04.288488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:04.288767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:04.289544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:04.289922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:04.291329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63720-9e73-44e9-b31d-6bc8e74f0903 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:04.303626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 640/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:04.309694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:04.402720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:04.411881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655bb3b-6b6f-49ea-a44b-df2dc31dd2e0 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:04.447027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921e4a-186d-4801-bdc3-bc6214c379d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:04.448023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921e4a-186d-4801-bdc3-bc6214c379d7 None admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:04.448435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921e4a-186d-4801-bdc3-bc6214c379d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:04.448937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921e4a-186d-4801-bdc3-bc6214c379d7 None admin] PATH_INFO: `/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/c508de5b7417417da87d702090178c8a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:04.451175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921e4a-186d-4801-bdc3-bc6214c379d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12b34755d58449183dd5fc2a17d16db, user_id=c508de5b7417417da87d702090178c8a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:04.452710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921e4a-186d-4801-bdc3-bc6214c379d7 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:04.585410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 633/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 25 22:38:04 2022] PUT /identity/v3/projects/e12b34755d58449183dd5fc2a17d16db/users/c508de5b7417417da87d702090178c8a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:38:06.611709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1c5d3-b248-4a85-98c7-489b463805a5 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:06.612255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1c5d3-b248-4a85-98c7-489b463805a5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:06.612370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1c5d3-b248-4a85-98c7-489b463805a5 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:06.614264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 641/1274] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:06.619624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:06.622048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:06.622048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:06.638518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:06.639746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:06.708491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 634/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:38:06.732430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1c5d3-b248-4a85-98c7-489b463805a5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:06.836800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1c5d3-b248-4a85-98c7-489b463805a5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:06.854279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:06.870492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:06.871068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:06.871349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:06.871624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:06.881429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:06.886286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:06.887366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:06.888304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 642/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:06.893622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:06.979375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:06.997772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba311e8d-bebf-40cd-9be0-dd35ba78fea8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:07.031858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:07.032481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:07.032770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:07.033074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:07.034043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:07.034359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:07.035977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:07.044142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 635/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:07.050081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:07.155882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6c76-1824-46f0-83be-382f349173b8 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:07.190737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:07.191373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:07.191898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:07.192186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:07.202588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:07.204057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:38:07.218004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:07.220335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:07.221490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:38:07.221490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:38:07.221490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:07.221490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:07.221490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 643/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:07.226144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:07.328963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04e948-3566-411e-a382-22a35a6c6101 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:07.365228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:07.365877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:07.366165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:07.366442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:07.367133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:07.367442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:07.368862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:07.381354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 636/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:07.387226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:07.418857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:07.486961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d362e9-cdca-47a7-87ad-bd6cdaceab11 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:07.522054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:07.522703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:07.522986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:07.523257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:07.531176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:07.532652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:38:07.544890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:07.551586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:07.552764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 644/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:07.553528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:07.556086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:07.656990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5bb0e-8652-4d58-9655-d0f40fd96150 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:07.693770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:07.694321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:07.694611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:07.694894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:07.695695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:07.696038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:07.698259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:07.716115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 637/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 25 22:38:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:07.722052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:07.814098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:07.824248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91141f1c-d3f6-441c-9c3c-7029f3b03010 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:07.857827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:07.858450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:07.858736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:07.859009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:07.927244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:07.928714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:08.016965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:08.027018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 645/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:38:08.033008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:08.100087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:08.140605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1415-8004-4e08-a958-c0cc4e868514 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:08.176934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:08.177759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:08.178056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:08.178334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:08.188301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:08.192889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:38:08.204294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:08.205330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:08.206369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:38:08.206369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:38:08.206369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:08.206369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:08.206369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 638/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:08.211728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:08.311242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f254aa-5f51-47e9-8683-97789e9e197a None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:08.345390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:08.346012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:08.346300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:08.346580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:08.347279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:08.347587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:08.349658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:08.362595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 646/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 25 22:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:08.368601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:08.473682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd22ac-0b50-4a97-b14c-3117cfa0a9fd None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:08.488950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:08.509661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:08.510304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:08.510579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:08.510853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:08.517674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:08.519377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:38:08.530869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:08.531985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: ERROR keystone.server.flask.application Jul 25 22:38:08.533095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 639/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 25 22:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:08.538414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:08.589592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:08.641977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3f83-bb1a-4897-b2a4-de628045a366 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:08.675517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:08.676779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:08.677118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:08.677400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:08.678157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:08.678470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:08.679933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ee92-0a4c-4f3f-ac40-0f30a6e8210d None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:08.692080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 647/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 25 22:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:08.698246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:08.800139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205e12-21be-4de5-a1be-700a10acd7f5 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:08.833741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:08.834380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:08.834669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:08.834945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:08.835745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] RBAC: Adding query filter params (role.id=bd1b5227e66846ed80031017e70bdd5c, scope.project.id=e12b34755d58449183dd5fc2a17d16db, user.id=c508de5b7417417da87d702090178c8a) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:08.836090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:08.837529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596dde4-47dc-4d18-ae35-d883dca3dc56 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:08.845088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 640/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:08 2022] GET /identity/v3/role_assignments?user.id=c508de5b7417417da87d702090178c8a&scope.project.id=e12b34755d58449183dd5fc2a17d16db&role.id=bd1b5227e66846ed80031017e70bdd5c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:10.853424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553334e-cd5f-4fbd-b5ca-48cf0d808621 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:10.854023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553334e-cd5f-4fbd-b5ca-48cf0d808621 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:10.854023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553334e-cd5f-4fbd-b5ca-48cf0d808621 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:10.855321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 648/1288] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:10.860756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:10.861232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:10.861365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:10.880529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:10.881752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:10.913127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:10.954937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 641/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:38:10.977471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553334e-cd5f-4fbd-b5ca-48cf0d808621 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:11.080425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553334e-cd5f-4fbd-b5ca-48cf0d808621 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:11.091643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:11.114983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:11.114983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:11.115293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:11.115604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:11.116286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:11.117685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:11.127559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:11.129454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:11.130566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 649/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:38:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:11.136052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:11.248369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890b593-2f1d-4064-bdd8-99d2bd635752 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:11.285843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:11.286478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:11.286765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:11.287045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:11.287744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:11.288085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:11.289473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65bbce-23cd-4368-b947-48ffa03f19d6 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:11.295056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 642/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 25 22:38:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:11.302324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:11.416084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f75b-dc60-4e0d-81c2-a01c68087803 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:11.458187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:11.458816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:11.459101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:11.459374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] PATH_INFO: `/v3/services` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:11.460093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:11.460397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:11.461837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33c399-5e70-4301-bfca-7c735be612d8 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:11.466496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 650/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 25 22:38:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:13.470526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee9af-8938-4428-87f3-8c00c1665a22 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:13.471073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee9af-8938-4428-87f3-8c00c1665a22 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:13.471073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ee9af-8938-4428-87f3-8c00c1665a22 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:13.472449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 643/1293] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:13.478357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176233d-be3f-427e-9c90-da95b0c8a50c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:13.478768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176233d-be3f-427e-9c90-da95b0c8a50c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:13.478921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176233d-be3f-427e-9c90-da95b0c8a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:13.497955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c176233d-be3f-427e-9c90-da95b0c8a50c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:13.499162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c176233d-be3f-427e-9c90-da95b0c8a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:13.529562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:13.567926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 651/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:38:13.589616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee9af-8938-4428-87f3-8c00c1665a22 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:13.623601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:13.696332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ee9af-8938-4428-87f3-8c00c1665a22 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:13.734167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0c296-ba5b-43d5-a061-b30b28b43c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:13.734859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c296-ba5b-43d5-a061-b30b28b43c3a None admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:13.735116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c296-ba5b-43d5-a061-b30b28b43c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:13.735394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0c296-ba5b-43d5-a061-b30b28b43c3a None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:13.736280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c296-ba5b-43d5-a061-b30b28b43c3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:13.737703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0c296-ba5b-43d5-a061-b30b28b43c3a None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:13.813669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 644/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 25 22:38:13 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:15.865881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada79a94-b227-46d1-8106-1b1c931f7dc4 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:15.866426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada79a94-b227-46d1-8106-1b1c931f7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:15.866426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada79a94-b227-46d1-8106-1b1c931f7dc4 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:15.867911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 652/1296] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:15.873237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:15.873691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:15.873797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:15.892133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:15.893329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:15.969345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 645/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:38:15.992815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada79a94-b227-46d1-8106-1b1c931f7dc4 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:16.099368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada79a94-b227-46d1-8106-1b1c931f7dc4 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:16.134844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:16.135406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:16.135406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:16.135406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:16.135406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:16.140909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:16.147831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:16.148988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:16.149851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 653/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:38:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:16.155640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:16.174540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:16.258844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3660698-fc2b-4cd3-9b69-f877d9221a94 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:16.295170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:16.295877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:16.296165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:16.296442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:16.297134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:16.297498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:16.298877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:16.304699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 646/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 25 22:38:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:16.310779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:16.349815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:16.422269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ba60f-58fd-44f9-833c-93082ffaba74 None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:16.456220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:16.457083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:16.457239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:16.457495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:16.458341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] RBAC: Adding query filter params (interface=public, service_id=b08a9c3b06e74fd89bcbf7984b7b7912, region_id=RegionOne) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:16.458655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:16.460053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11137c15-1475-45d4-83bb-d15a691fa4aa None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:16.465199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 654/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 25 22:38:16 2022] GET /identity/v3/endpoints?service_id=b08a9c3b06e74fd89bcbf7984b7b7912&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:16.471291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:16.559350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:16.577752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2aa9-15e9-4d3a-b12b-7ea585a86077 None admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:16.611442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbf884-6eed-400a-bfb6-04eabf67f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:16.612099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbf884-6eed-400a-bfb6-04eabf67f41d None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:16.612388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbf884-6eed-400a-bfb6-04eabf67f41d None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:16.612666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbf884-6eed-400a-bfb6-04eabf67f41d None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:16.613843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbf884-6eed-400a-bfb6-04eabf67f41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:16.615388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbf884-6eed-400a-bfb6-04eabf67f41d None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:16.622259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 647/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 25 22:38:16 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:38:18.636320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179411-1973-40b8-a7df-70785c9387eb None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:18.636859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179411-1973-40b8-a7df-70785c9387eb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:18.636859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179411-1973-40b8-a7df-70785c9387eb None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:18.638229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 655/1302] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:18.643537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:18.644027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:18.644136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:18.664092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:18.665312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:18.735135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 648/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:38:18.757362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179411-1973-40b8-a7df-70785c9387eb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:18.854510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:18.862715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179411-1973-40b8-a7df-70785c9387eb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:18.896657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3902-868e-4434-8126-2098508d814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:18.897278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3902-868e-4434-8126-2098508d814b None admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:18.897565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3902-868e-4434-8126-2098508d814b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:18.897850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3902-868e-4434-8126-2098508d814b None admin] PATH_INFO: `/v3/services/placement` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:18.898480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b3902-868e-4434-8126-2098508d814b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:18.899866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b3902-868e-4434-8126-2098508d814b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application [None req-da4b3902-868e-4434-8126-2098508d814b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:18.909815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:18.911804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: ERROR keystone.server.flask.application Jul 25 22:38:18.912837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 656/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 25 22:38:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:18.917931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:18.995207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:19.018538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d21e6-70a9-4586-836f-679e8eacf041 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:19.054481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:19.055115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:19.055401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:19.055681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] PATH_INFO: `/v3/services` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:19.056404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:19.056711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:19.058254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133aa4-3d53-4820-9701-08b5f8a92d8b None admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:19.064600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 649/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 25 22:38:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:19.074215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3902-868e-4434-8126-2098508d814b None admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:19.174366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3902-868e-4434-8126-2098508d814b None admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:19.209903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60eae5-f56b-4aac-b981-29dba7302e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:19.210517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60eae5-f56b-4aac-b981-29dba7302e0b None admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:19.210803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60eae5-f56b-4aac-b981-29dba7302e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:19.211084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60eae5-f56b-4aac-b981-29dba7302e0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:19.211839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60eae5-f56b-4aac-b981-29dba7302e0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:19.213237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60eae5-f56b-4aac-b981-29dba7302e0b None admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:19.356834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 657/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:38:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:29.061356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=30 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:29.351718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.327496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326ba0-975a-46e5-934f-51b2c11c8c7c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.328113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326ba0-975a-46e5-934f-51b2c11c8c7c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.328574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326ba0-975a-46e5-934f-51b2c11c8c7c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.340438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a148a-deb1-48a2-b172-1cc952841c04 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.341002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a148a-deb1-48a2-b172-1cc952841c04 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.341448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a148a-deb1-48a2-b172-1cc952841c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.346796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 650/1307] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:44:43 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:43.527070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-542a148a-deb1-48a2-b172-1cc952841c04 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:43.529523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-542a148a-deb1-48a2-b172-1cc952841c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:43.750524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 658/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:44:43.830181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d14da-4b75-486a-b5fa-2645cc2996e5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.830768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d14da-4b75-486a-b5fa-2645cc2996e5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.831413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d14da-4b75-486a-b5fa-2645cc2996e5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.834343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 651/1309] 10.222.0.40 () {54 vars in 965 bytes} [Mon Jul 25 22:44:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:43.848492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2cfe6-9752-4994-a70f-5cb5bee44ffd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.848789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2cfe6-9752-4994-a70f-5cb5bee44ffd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.849068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2cfe6-9752-4994-a70f-5cb5bee44ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.978993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c3f2cfe6-9752-4994-a70f-5cb5bee44ffd None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:43.980549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c3f2cfe6-9752-4994-a70f-5cb5bee44ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:44.028456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:44.126103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 659/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Mon Jul 25 22:44:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:44.127605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d14da-4b75-486a-b5fa-2645cc2996e5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:44.135305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-202d14da-4b75-486a-b5fa-2645cc2996e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:44.443050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d14da-4b75-486a-b5fa-2645cc2996e5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:44.636900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:44.638421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:44.639228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:44.639914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:44.643557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:44.786170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:44.920214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:44.923381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a8764-b93a-4f8a-a758-150f245afaf2 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:44.969163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 652/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:47.339434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062a0e-e5e1-4915-a461-1e209ebba0fd None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.340124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062a0e-e5e1-4915-a461-1e209ebba0fd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.340124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062a0e-e5e1-4915-a461-1e209ebba0fd None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.341393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 660/1312] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:44:47.347462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978067a5-db87-42bc-ab57-125f35073c13 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.348037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978067a5-db87-42bc-ab57-125f35073c13 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.348156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978067a5-db87-42bc-ab57-125f35073c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.432099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-978067a5-db87-42bc-ab57-125f35073c13 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:47.433429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-978067a5-db87-42bc-ab57-125f35073c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:47.541311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 653/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:47.584841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2062a0e-e5e1-4915-a461-1e209ebba0fd None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:47.587118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c2062a0e-e5e1-4915-a461-1e209ebba0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:47.705989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2062a0e-e5e1-4915-a461-1e209ebba0fd None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:47.788126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:47.793736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:47.794782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:47.795069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:47.795452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:47.797249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:47.921419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:47.922886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5564c-3e6c-46b2-8567-bd39f7e80bbb service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:47.943369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 661/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:50.688010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2417662-5ce0-4b8b-9d27-41046be75006 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.688570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2417662-5ce0-4b8b-9d27-41046be75006 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.688570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2417662-5ce0-4b8b-9d27-41046be75006 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.690002 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 654/1315] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:50.696255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38fe9-581b-4371-94f6-2b393abe1aa7 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.696848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38fe9-581b-4371-94f6-2b393abe1aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.696848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38fe9-581b-4371-94f6-2b393abe1aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.777858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3fc38fe9-581b-4371-94f6-2b393abe1aa7 None None] MFA Rules not processed for user `51e8d5dea332458fad311662d57a861a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:50.779127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3fc38fe9-581b-4371-94f6-2b393abe1aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:50.837925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.900046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 662/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:50.941622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2417662-5ce0-4b8b-9d27-41046be75006 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.943154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d2417662-5ce0-4b8b-9d27-41046be75006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:50.953661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.062710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2417662-5ce0-4b8b-9d27-41046be75006 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:51.140980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:51.141593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:51.141877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:51.142146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:51.143798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:51.212375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:51.263093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:51.264762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef619ae-dc82-4014-b974-3ddf88ec730d service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.289809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 655/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:54.320678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45148-8aae-4083-88e5-9f28f4f38abf None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.321519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45148-8aae-4083-88e5-9f28f4f38abf None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.321678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db45148-8aae-4083-88e5-9f28f4f38abf None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.323116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 663/1318] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:44:54.328938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ab1d-f5cb-4412-aee7-4146099b97fe None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.329449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ab1d-f5cb-4412-aee7-4146099b97fe None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.329678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ab1d-f5cb-4412-aee7-4146099b97fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.405443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-bc89ab1d-f5cb-4412-aee7-4146099b97fe None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:54.406734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-bc89ab1d-f5cb-4412-aee7-4146099b97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:54.517236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 656/1319] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:44:54.573708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbca685-4289-4937-bd81-08c4b8152ceb None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.573982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbca685-4289-4937-bd81-08c4b8152ceb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.574251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbca685-4289-4937-bd81-08c4b8152ceb None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.575745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 664/1320] 10.222.0.40 () {54 vars in 965 bytes} [Mon Jul 25 22:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:54.583384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762fd9b-86cc-4089-a64d-5929aea613a6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:54.583936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762fd9b-86cc-4089-a64d-5929aea613a6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:54.584406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762fd9b-86cc-4089-a64d-5929aea613a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:54.625513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:54.721715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7762fd9b-86cc-4089-a64d-5929aea613a6 None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:54.723023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7762fd9b-86cc-4089-a64d-5929aea613a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:54.849017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 657/1321] 10.222.0.40 () {58 vars in 1062 bytes} [Mon Jul 25 22:44:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:54.858224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbca685-4289-4937-bd81-08c4b8152ceb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:54.859816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4cbca685-4289-4937-bd81-08c4b8152ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:54.972931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbca685-4289-4937-bd81-08c4b8152ceb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:55.063491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:55.064174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:55.064460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:55.064733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:55.066502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:55.075316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:55.189127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:55.190577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f9758-2fe0-455b-a11e-94db55a8bbe5 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:55.211021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 665/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:59.106134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f50066-0528-49ac-9b4a-666279d2c03f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.106990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f50066-0528-49ac-9b4a-666279d2c03f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.107151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f50066-0528-49ac-9b4a-666279d2c03f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.108741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 658/1323] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:59.114489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6369-6375-4605-8bc6-cb4636b6ea01 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.115014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6369-6375-4605-8bc6-cb4636b6ea01 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.115104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6369-6375-4605-8bc6-cb4636b6ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.192023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9ebb6369-6375-4605-8bc6-cb4636b6ea01 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:59.193940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9ebb6369-6375-4605-8bc6-cb4636b6ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:59.273116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.324618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 666/1324] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:59.364093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f50066-0528-49ac-9b4a-666279d2c03f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:59.367307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d6f50066-0528-49ac-9b4a-666279d2c03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:59.493179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f50066-0528-49ac-9b4a-666279d2c03f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:59.511657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:59.595299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:59.596404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:59.596871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:59.597350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:59.601189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:59.793831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:59.796186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3dbc4-d64a-406d-b9a1-d7926e222be2 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:59.834896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 659/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:02.065612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63c57-a9ac-4d85-830c-d2e7ad1358bc None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.066447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63c57-a9ac-4d85-830c-d2e7ad1358bc None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.066447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d63c57-a9ac-4d85-830c-d2e7ad1358bc None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.071857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 667/1326] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:02.074216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db053908-b1a1-43c8-b636-3ffc7f21d133 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.074985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db053908-b1a1-43c8-b636-3ffc7f21d133 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.074985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db053908-b1a1-43c8-b636-3ffc7f21d133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.151920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.174944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-db053908-b1a1-43c8-b636-3ffc7f21d133 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:02.176263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-db053908-b1a1-43c8-b636-3ffc7f21d133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:02.327615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 660/1327] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:02.370597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63c57-a9ac-4d85-830c-d2e7ad1358bc None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:02.372288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-92d63c57-a9ac-4d85-830c-d2e7ad1358bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:02.501860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d63c57-a9ac-4d85-830c-d2e7ad1358bc None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:02.608637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:02.608637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:02.608637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:02.608637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:02.609430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:02.612801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.736280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:02.737746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603bab2-a08c-4a0e-a245-4f5959471658 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:02.759687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 668/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:04.955084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c444c8-53f2-4601-b560-5f33a2d4b1e5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.955928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c444c8-53f2-4601-b560-5f33a2d4b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.955928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c444c8-53f2-4601-b560-5f33a2d4b1e5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:04.956972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 661/1329] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:04.964213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271f21-fec7-40c1-9a37-3a0942bca36a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:04.964708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271f21-fec7-40c1-9a37-3a0942bca36a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:04.965206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8271f21-fec7-40c1-9a37-3a0942bca36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.056105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e8271f21-fec7-40c1-9a37-3a0942bca36a None None] MFA Rules not processed for user `51e8d5dea332458fad311662d57a861a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:05.057369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e8271f21-fec7-40c1-9a37-3a0942bca36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:05.134122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.168778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 669/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:05.211188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c444c8-53f2-4601-b560-5f33a2d4b1e5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:05.213854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a6c444c8-53f2-4601-b560-5f33a2d4b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:05.373822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c444c8-53f2-4601-b560-5f33a2d4b1e5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:05.400346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.460481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:05.461107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.461455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.461673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.463367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:05.598730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:05.600249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5736d33-a5db-411b-b4c8-dcc256b0a950 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:05.623176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 662/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:08.531907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db069-0feb-4ddf-97bf-a3a80bc19a92 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.532538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db069-0feb-4ddf-97bf-a3a80bc19a92 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.532538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db069-0feb-4ddf-97bf-a3a80bc19a92 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.533851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 670/1332] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:08.540213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ae4ea-df88-4ae7-b3b3-0fd3a0334f88 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.540788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ae4ea-df88-4ae7-b3b3-0fd3a0334f88 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.540920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ae4ea-df88-4ae7-b3b3-0fd3a0334f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.632672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:08.636935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f20ae4ea-df88-4ae7-b3b3-0fd3a0334f88 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:08.638757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f20ae4ea-df88-4ae7-b3b3-0fd3a0334f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:08.763644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 663/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:08.802759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db069-0feb-4ddf-97bf-a3a80bc19a92 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:08.804387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cf8db069-0feb-4ddf-97bf-a3a80bc19a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:08.969557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db069-0feb-4ddf-97bf-a3a80bc19a92 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.052896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.053723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.054125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.054412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.056178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:09.087626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.189646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.191133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae96d75-421c-4857-9956-4ceac5cd87db service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.214463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 671/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:11.347228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57696a4-2911-4e50-a513-a502cc30e4f6 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.347959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57696a4-2911-4e50-a513-a502cc30e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.347959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57696a4-2911-4e50-a513-a502cc30e4f6 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.349286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 664/1335] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:11.356273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104b9e8-c964-435f-aaba-eb0c27938eab None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.356824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104b9e8-c964-435f-aaba-eb0c27938eab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.357284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104b9e8-c964-435f-aaba-eb0c27938eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.479741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e104b9e8-c964-435f-aaba-eb0c27938eab None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:11.482003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e104b9e8-c964-435f-aaba-eb0c27938eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:11.586980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.614573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 672/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:11.658612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57696a4-2911-4e50-a513-a502cc30e4f6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:11.660264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e57696a4-2911-4e50-a513-a502cc30e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:11.776665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57696a4-2911-4e50-a513-a502cc30e4f6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:11.809136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.861795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:11.862432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.862721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.863025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.864762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:11.986532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:11.988028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23221f-fd62-454b-966b-479a45e94009 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:12.009984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 665/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:14.954959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b7281-96f7-48a3-9bc3-c445c1bcc9db None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.955575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b7281-96f7-48a3-9bc3-c445c1bcc9db None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.955575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b7281-96f7-48a3-9bc3-c445c1bcc9db None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.957288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 673/1338] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:14.964070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8cf26-0822-4457-bdd3-949f33731fea None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.964908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8cf26-0822-4457-bdd3-949f33731fea None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.964908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8cf26-0822-4457-bdd3-949f33731fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.041557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4ec8cf26-0822-4457-bdd3-949f33731fea None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:15.042812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4ec8cf26-0822-4457-bdd3-949f33731fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:15.051970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.153633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 666/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:15.191855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b7281-96f7-48a3-9bc3-c445c1bcc9db None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.193800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b75b7281-96f7-48a3-9bc3-c445c1bcc9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:15.319227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b7281-96f7-48a3-9bc3-c445c1bcc9db None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.407923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.408563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.408849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.409126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.410952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:15.453116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.543973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.545446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e79c9-ad38-488c-9a92-4866e158a119 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.567284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 674/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:20.436043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75b59-c4ab-4d41-9e8b-187bcf5e0c7d None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.436610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75b59-c4ab-4d41-9e8b-187bcf5e0c7d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.436610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75b59-c4ab-4d41-9e8b-187bcf5e0c7d None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.437942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 667/1341] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:20.443683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badc79f-6a80-4514-87a4-8bb1cb9b7bf6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.444281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badc79f-6a80-4514-87a4-8bb1cb9b7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.444427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badc79f-6a80-4514-87a4-8bb1cb9b7bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.548596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0badc79f-6a80-4514-87a4-8bb1cb9b7bf6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:20.550101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0badc79f-6a80-4514-87a4-8bb1cb9b7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:20.671414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.691695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 675/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:20.733940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe75b59-c4ab-4d41-9e8b-187bcf5e0c7d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.735732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3fe75b59-c4ab-4d41-9e8b-187bcf5e0c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:20.878722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe75b59-c4ab-4d41-9e8b-187bcf5e0c7d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.934630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:21.011889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:21.013232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:21.013837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:21.014512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:21.018377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:21.222549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:21.224431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb4c88-1593-4e28-b439-ee370c541025 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:21.247009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 668/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:24.531179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4851-9db8-4030-bfdb-5e8aa75162c3 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.531717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4851-9db8-4030-bfdb-5e8aa75162c3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.531946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4851-9db8-4030-bfdb-5e8aa75162c3 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.533527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 676/1344] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:24.540267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f0f21-ced6-4aa7-892b-8ca829de4f17 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:24.540819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f0f21-ced6-4aa7-892b-8ca829de4f17 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:24.540819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f0f21-ced6-4aa7-892b-8ca829de4f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:24.617131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-bd0f0f21-ced6-4aa7-892b-8ca829de4f17 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:24.618384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-bd0f0f21-ced6-4aa7-892b-8ca829de4f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:24.639081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:24.731273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 669/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:24.771772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f4851-9db8-4030-bfdb-5e8aa75162c3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:24.773719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-630f4851-9db8-4030-bfdb-5e8aa75162c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:24.909759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f4851-9db8-4030-bfdb-5e8aa75162c3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:25.034643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:25.035290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.035577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.035888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.038319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:25.097889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:25.206850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:25.209582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc8342-24a1-42dc-a327-2f52adbc9e65 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:25.246773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 677/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:30.170330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f501ad-0381-4a0c-a486-d59fbc145c7b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:30.171183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f501ad-0381-4a0c-a486-d59fbc145c7b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:30.171326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f501ad-0381-4a0c-a486-d59fbc145c7b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:30.173894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 670/1347] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:30.182677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85a5a-77ee-400b-87f0-cf8c0e0f8a2c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:30.183480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85a5a-77ee-400b-87f0-cf8c0e0f8a2c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:30.183480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85a5a-77ee-400b-87f0-cf8c0e0f8a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:30.258385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-00e85a5a-77ee-400b-87f0-cf8c0e0f8a2c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:30.259545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-00e85a5a-77ee-400b-87f0-cf8c0e0f8a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:30.374854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:30.383885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 678/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:30.424412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f501ad-0381-4a0c-a486-d59fbc145c7b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:30.426318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e1f501ad-0381-4a0c-a486-d59fbc145c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:30.579262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f501ad-0381-4a0c-a486-d59fbc145c7b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:30.633405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:30.668356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:30.669184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:30.669524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:30.669878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:30.671622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:30.814446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:30.815936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c90ef-cb4e-4a23-9e90-13f4736b432c service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:30.837787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 671/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:36.602375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830de12-5c45-4430-84fb-54ba5880d843 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:36.603725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830de12-5c45-4430-84fb-54ba5880d843 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:36.604081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830de12-5c45-4430-84fb-54ba5880d843 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:36.607978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 679/1350] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:45:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:36.612946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733345-2b9e-4984-a501-f8a4b5ad6378 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:36.613496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733345-2b9e-4984-a501-f8a4b5ad6378 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:36.613582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733345-2b9e-4984-a501-f8a4b5ad6378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:36.712645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-88733345-2b9e-4984-a501-f8a4b5ad6378 None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:36.712645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-88733345-2b9e-4984-a501-f8a4b5ad6378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:36.747979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:36.915482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 672/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:45:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:42.259861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450d6c9-8c73-418d-afb3-8e640a6deb10 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:42.261434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450d6c9-8c73-418d-afb3-8e640a6deb10 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:42.262127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450d6c9-8c73-418d-afb3-8e640a6deb10 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:42.264679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 680/1352] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:45:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:42.271047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2774-a391-48c6-8450-3baf8c0be90e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:42.271991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2774-a391-48c6-8450-3baf8c0be90e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:42.271991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2774-a391-48c6-8450-3baf8c0be90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:42.360633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b00d2774-a391-48c6-8450-3baf8c0be90e None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:42.361963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b00d2774-a391-48c6-8450-3baf8c0be90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:42.451215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:42.495973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 673/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:45:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:44.211928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dade1-d102-4167-888d-9f3fe3f6316f None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.212819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dade1-d102-4167-888d-9f3fe3f6316f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.212819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dade1-d102-4167-888d-9f3fe3f6316f None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.213915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 681/1354] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:44.219943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5f1da-45c8-4daf-8112-8abe9b38e48e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:44.220756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5f1da-45c8-4daf-8112-8abe9b38e48e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:44.220756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5f1da-45c8-4daf-8112-8abe9b38e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:44.352377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-60e5f1da-45c8-4daf-8112-8abe9b38e48e None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:44.353694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-60e5f1da-45c8-4daf-8112-8abe9b38e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:44.503217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 674/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:45:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:48.204438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b185-e9a0-4db3-82b8-a76f8a9be06f None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.205321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b185-e9a0-4db3-82b8-a76f8a9be06f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.205321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b185-e9a0-4db3-82b8-a76f8a9be06f None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.206357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 682/1356] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:48.212927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4af9a-eb05-44dd-a3c5-d80254855cbe None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.215930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4af9a-eb05-44dd-a3c5-d80254855cbe None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.215930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4af9a-eb05-44dd-a3c5-d80254855cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.255339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:48.323864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-96c4af9a-eb05-44dd-a3c5-d80254855cbe None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:48.325518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-96c4af9a-eb05-44dd-a3c5-d80254855cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:48.519855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 675/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:48.587884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34524eca-aaa2-457f-9ec1-738b359bc2b2 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.588427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34524eca-aaa2-457f-9ec1-738b359bc2b2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.588911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34524eca-aaa2-457f-9ec1-738b359bc2b2 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.590708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 683/1358] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jul 25 22:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:48.603964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd122434-7bd8-4fc9-88fe-9c31f43fbfae None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:48.604871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd122434-7bd8-4fc9-88fe-9c31f43fbfae None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:48.605923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd122434-7bd8-4fc9-88fe-9c31f43fbfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:48.748657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dd122434-7bd8-4fc9-88fe-9c31f43fbfae None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:48.750275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dd122434-7bd8-4fc9-88fe-9c31f43fbfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:48.836619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:48.967451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 676/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jul 25 22:45:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:48.981274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34524eca-aaa2-457f-9ec1-738b359bc2b2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:48.982791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-34524eca-aaa2-457f-9ec1-738b359bc2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:49.157732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34524eca-aaa2-457f-9ec1-738b359bc2b2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:49.239166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:49.290116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:49.290116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:49.290116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:49.290116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:49.290694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:49.425749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:49.429083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd23dbd-0ea0-4c2c-b439-9488300bf112 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:49.453837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 684/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:51.866344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35513870-3d78-4e14-a48b-e68faf3bb3ad None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:51.866906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35513870-3d78-4e14-a48b-e68faf3bb3ad None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:51.867439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35513870-3d78-4e14-a48b-e68faf3bb3ad None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:51.870249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 677/1361] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:51.876084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd438c-d084-464b-a2ea-7771c53f4077 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:51.876833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd438c-d084-464b-a2ea-7771c53f4077 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:51.876833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd438c-d084-464b-a2ea-7771c53f4077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:51.967394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-fbcd438c-d084-464b-a2ea-7771c53f4077 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:51.969332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fbcd438c-d084-464b-a2ea-7771c53f4077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:52.042391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:52.153164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 685/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:52.210617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35513870-3d78-4e14-a48b-e68faf3bb3ad None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:52.212292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-35513870-3d78-4e14-a48b-e68faf3bb3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:52.482303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35513870-3d78-4e14-a48b-e68faf3bb3ad None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:52.495964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:52.672402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:52.673208 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:52.673568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:52.673940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:52.675814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:52.871285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:52.875375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b126d9f-f472-42ea-a9ce-6a7f84b62599 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:52.912395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 678/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:55.793718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e1cb1-c8ba-4bec-81f3-8d1307d6ce93 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.794733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e1cb1-c8ba-4bec-81f3-8d1307d6ce93 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.794860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e1cb1-c8ba-4bec-81f3-8d1307d6ce93 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.797025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 686/1364] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:55.803943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3eee5-f6f9-42c2-9098-dcd8ac4c1820 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:55.804706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3eee5-f6f9-42c2-9098-dcd8ac4c1820 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:55.804706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3eee5-f6f9-42c2-9098-dcd8ac4c1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:55.830781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:55.920140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d7e3eee5-f6f9-42c2-9098-dcd8ac4c1820 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:55.921601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d7e3eee5-f6f9-42c2-9098-dcd8ac4c1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:56.043887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 679/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:56.114234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4351b9e-1d63-46c6-a420-e00bab0b0472 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.115118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4351b9e-1d63-46c6-a420-e00bab0b0472 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.115743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4351b9e-1d63-46c6-a420-e00bab0b0472 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.118896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 687/1366] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jul 25 22:45:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:56.124963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286b7e-f7c0-4434-8c0f-05f708d74c64 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.125227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286b7e-f7c0-4434-8c0f-05f708d74c64 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.125664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286b7e-f7c0-4434-8c0f-05f708d74c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.242178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d3286b7e-f7c0-4434-8c0f-05f708d74c64 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:56.244010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d3286b7e-f7c0-4434-8c0f-05f708d74c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:56.295219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:56.427647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 680/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jul 25 22:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:56.436828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4351b9e-1d63-46c6-a420-e00bab0b0472 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:56.438509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e4351b9e-1d63-46c6-a420-e00bab0b0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:56.625386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4351b9e-1d63-46c6-a420-e00bab0b0472 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:56.650667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:56.805122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:56.806291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:56.806291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:56.807008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:56.810193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:56.953068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:56.956424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b99a-c5db-4218-b071-24ac4bbb6c91 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:56.995893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 688/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:57.747752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc9af-ff9f-4459-8310-b590aae75471 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.747752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc9af-ff9f-4459-8310-b590aae75471 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.750354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc9af-ff9f-4459-8310-b590aae75471 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.753661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 681/1369] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:57.760639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d196-dd44-4c58-a3a4-f590e435d2c1 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.761690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d196-dd44-4c58-a3a4-f590e435d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.762264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d196-dd44-4c58-a3a4-f590e435d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.830672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.911165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-8139d196-dd44-4c58-a3a4-f590e435d2c1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:57.913813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8139d196-dd44-4c58-a3a4-f590e435d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:58.097256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 689/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:58.484776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b087a37-38ee-4e87-8d27-b45f178da808 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.484776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b087a37-38ee-4e87-8d27-b45f178da808 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.484776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b087a37-38ee-4e87-8d27-b45f178da808 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.484776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 682/1371] 10.222.0.40 () {54 vars in 964 bytes} [Mon Jul 25 22:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:58.493475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be38ac7-4e67-48ea-8607-0050537d8680 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.493756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be38ac7-4e67-48ea-8607-0050537d8680 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.494041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be38ac7-4e67-48ea-8607-0050537d8680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.602188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9be38ac7-4e67-48ea-8607-0050537d8680 None None] MFA Rules not processed for user `4957fb8ec82d40f985b586cda019a0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:58.603459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9be38ac7-4e67-48ea-8607-0050537d8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:58.673620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.711180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 690/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Jul 25 22:45:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:58.721582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b087a37-38ee-4e87-8d27-b45f178da808 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.723902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4b087a37-38ee-4e87-8d27-b45f178da808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:58.871708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b087a37-38ee-4e87-8d27-b45f178da808 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:58.924969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.969020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:58.969502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.970215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.970215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.972802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:59.115358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:59.117173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335f74a-2b34-456c-84fc-58e742a2e294 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:59.151891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 683/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:59.516191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866009-b00c-4190-8611-4fdf40f66004 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:59.516768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866009-b00c-4190-8611-4fdf40f66004 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:59.517103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866009-b00c-4190-8611-4fdf40f66004 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:59.519067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 691/1374] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:59.525626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618d21-216b-4f08-adf7-10ea5fe2da67 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:59.525913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618d21-216b-4f08-adf7-10ea5fe2da67 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:59.526191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618d21-216b-4f08-adf7-10ea5fe2da67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:59.600184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b0618d21-216b-4f08-adf7-10ea5fe2da67 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:59.601590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b0618d21-216b-4f08-adf7-10ea5fe2da67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:59.624430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:59.710977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 684/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:59.757715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866009-b00c-4190-8611-4fdf40f66004 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:59.759247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-51866009-b00c-4190-8611-4fdf40f66004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:59.915564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866009-b00c-4190-8611-4fdf40f66004 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:59.970472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:00.037710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:00.038334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:00.038614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:00.039048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:00.041366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:00.138283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:00.140027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77d285-295b-43b5-8b53-1986dafcbb5c service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:00.158809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 692/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:02.359160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84ef58-d184-4d50-af74-527c883f2283 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.359711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84ef58-d184-4d50-af74-527c883f2283 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.359711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84ef58-d184-4d50-af74-527c883f2283 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.361584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 685/1377] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:02.368192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989911-3d8d-40b5-9829-c8adf58ef1b0 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.368762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989911-3d8d-40b5-9829-c8adf58ef1b0 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.368762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989911-3d8d-40b5-9829-c8adf58ef1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.456593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5b989911-3d8d-40b5-9829-c8adf58ef1b0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:02.458739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5b989911-3d8d-40b5-9829-c8adf58ef1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:02.466909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.606675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 693/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:02.656032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84ef58-d184-4d50-af74-527c883f2283 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.657819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9e84ef58-d184-4d50-af74-527c883f2283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:02.849141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84ef58-d184-4d50-af74-527c883f2283 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.853366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.018424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.019153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.019494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.019988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.022486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:03.187567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.189580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914d481-9e04-4360-8baf-8a492f310286 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.214504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 686/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:05.460945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa451de3-1b4f-4df1-ad23-f8baa747c574 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.461688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa451de3-1b4f-4df1-ad23-f8baa747c574 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.461688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa451de3-1b4f-4df1-ad23-f8baa747c574 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.463181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 694/1380] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:05.468748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254e2e3-cbce-45e7-b1a4-ebc51bb8a4f1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.469181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254e2e3-cbce-45e7-b1a4-ebc51bb8a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.469291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254e2e3-cbce-45e7-b1a4-ebc51bb8a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.482439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:05.559301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a254e2e3-cbce-45e7-b1a4-ebc51bb8a4f1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:05.562943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a254e2e3-cbce-45e7-b1a4-ebc51bb8a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:05.700954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 687/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:05.748995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa451de3-1b4f-4df1-ad23-f8baa747c574 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:05.750787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aa451de3-1b4f-4df1-ad23-f8baa747c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:05.971839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:05.983921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa451de3-1b4f-4df1-ad23-f8baa747c574 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:06.146131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:06.147198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.147320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.147559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.149282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:06.266632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:06.268208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea222-d9cc-40c0-b2ac-5672f9a2c5fc service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:06.285388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:06.298340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 695/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:08.844427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522ed7-0082-4249-8416-b43fef225f0c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.845196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522ed7-0082-4249-8416-b43fef225f0c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.845196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522ed7-0082-4249-8416-b43fef225f0c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.846522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 688/1383] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:08.853371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90708b-7c49-404f-9785-ee1faaa8e8a1 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.853885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90708b-7c49-404f-9785-ee1faaa8e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.854013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90708b-7c49-404f-9785-ee1faaa8e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.939181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5a90708b-7c49-404f-9785-ee1faaa8e8a1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:08.940504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5a90708b-7c49-404f-9785-ee1faaa8e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:09.059087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 696/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:09.103042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522ed7-0082-4249-8416-b43fef225f0c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.104773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-91522ed7-0082-4249-8416-b43fef225f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:09.233302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.327112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522ed7-0082-4249-8416-b43fef225f0c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.461780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.462422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.462709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.462987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.464806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:09.536328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.588877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.590480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36e5a4-56b2-47f0-8064-7b1b3d5c3962 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.611163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 689/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:46:12.183659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfd9ae-28c5-473a-bd80-4e7bd8895f21 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.184320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfd9ae-28c5-473a-bd80-4e7bd8895f21 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.184320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfd9ae-28c5-473a-bd80-4e7bd8895f21 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.185826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 697/1386] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:12.193065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e1ff-bcc5-4a27-877e-f434f9641932 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.193650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e1ff-bcc5-4a27-877e-f434f9641932 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.193799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e1ff-bcc5-4a27-877e-f434f9641932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.266378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fa67e1ff-bcc5-4a27-877e-f434f9641932 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:12.267624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fa67e1ff-bcc5-4a27-877e-f434f9641932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.408559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 690/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:12.466658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfd9ae-28c5-473a-bd80-4e7bd8895f21 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:12.468257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-98dfd9ae-28c5-473a-bd80-4e7bd8895f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.569780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:12.648574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfd9ae-28c5-473a-bd80-4e7bd8895f21 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:12.789254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:12.789939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.790228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.790510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.792382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.853593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:12.918456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:12.920614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95d13-968d-4395-bfb6-1277b1027a91 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:12.940771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 698/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:15.109023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d8c0c-fd06-4912-8245-f9ad781c33d9 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.109637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d8c0c-fd06-4912-8245-f9ad781c33d9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.109637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d8c0c-fd06-4912-8245-f9ad781c33d9 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.110910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 691/1389] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:15.117810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edac63-6815-41a4-b11b-1513d9a7b485 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.118340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edac63-6815-41a4-b11b-1513d9a7b485 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.118447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edac63-6815-41a4-b11b-1513d9a7b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.141370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbb54-da9c-4a7f-be07-4edceba0ccb6 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.141714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbb54-da9c-4a7f-be07-4edceba0ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.141939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbb54-da9c-4a7f-be07-4edceba0ccb6 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.143313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 692/1390] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:15.149469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf643122-8cab-45d3-8bf2-19918ec10289 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.149751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf643122-8cab-45d3-8bf2-19918ec10289 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.150033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf643122-8cab-45d3-8bf2-19918ec10289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.189602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.191325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-81edac63-6815-41a4-b11b-1513d9a7b485 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:15.192669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-81edac63-6815-41a4-b11b-1513d9a7b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.226499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-bf643122-8cab-45d3-8bf2-19918ec10289 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:15.227777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-bf643122-8cab-45d3-8bf2-19918ec10289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.299989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 699/1391] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:46:15.340589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 693/1392] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:46:15.354889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921dac-f94d-4535-bf72-ae594e404c1e None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.355185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921dac-f94d-4535-bf72-ae594e404c1e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.355465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921dac-f94d-4535-bf72-ae594e404c1e None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.356856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 700/1393] 10.222.0.40 () {54 vars in 966 bytes} [Mon Jul 25 22:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:15.362098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.362582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.362905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.385032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921dac-f94d-4535-bf72-ae594e404c1e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.386603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7d921dac-f94d-4535-bf72-ae594e404c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.401904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.450043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] MFA Rules not processed for user `e9a8f7e27170404ebf1a2be70efe63fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:15.451958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.519495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.551616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 694/1394] 10.222.0.40 () {58 vars in 1063 bytes} [Mon Jul 25 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:15.560146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:15.561770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d921dac-f94d-4535-bf72-ae594e404c1e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.568652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737acd2-ec64-4573-bac4-7015ad3d7b9b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:15.657666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.658215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.658502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.658783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.661024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.669498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.699740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:15.700705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:15.701219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:15.701833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:15.704376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.792507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.793961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6b42a-4edf-45c4-83ce-a3605da723f7 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.799925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.801636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682e103-a071-4c70-a0b1-caf7f8c83e00 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.810035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:15.816124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 695/1395] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:15.824424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 701/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:46:16.732494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399434-893e-48e5-b4b1-f7300274b03c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:16.733000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399434-893e-48e5-b4b1-f7300274b03c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:16.733109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74399434-893e-48e5-b4b1-f7300274b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:16.803577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-74399434-893e-48e5-b4b1-f7300274b03c None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:16.804840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-74399434-893e-48e5-b4b1-f7300274b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:16.898664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 696/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:46:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:16.943339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22b90-54dd-4090-8ca3-f1f09b86e3ec None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:16.943897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22b90-54dd-4090-8ca3-f1f09b86e3ec None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:16.944096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22b90-54dd-4090-8ca3-f1f09b86e3ec None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:16.945559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 702/1398] 10.222.0.40 () {54 vars in 943 bytes} [Mon Jul 25 22:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:16.951922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334afd-3153-4e6e-a740-bf35eb48ea77 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:16.952286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334afd-3153-4e6e-a740-bf35eb48ea77 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:16.952636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334afd-3153-4e6e-a740-bf35eb48ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.033670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ed334afd-3153-4e6e-a740-bf35eb48ea77 None None] MFA Rules not processed for user `702abbf0ba844ec99db46a7b0c54b288`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:17.034923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ed334afd-3153-4e6e-a740-bf35eb48ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:17.067082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:17.147899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 697/1399] 10.222.0.40 () {58 vars in 1040 bytes} [Mon Jul 25 22:46:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:17.157204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22b90-54dd-4090-8ca3-f1f09b86e3ec None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:17.158840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ffb22b90-54dd-4090-8ca3-f1f09b86e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:17.258489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:17.303769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22b90-54dd-4090-8ca3-f1f09b86e3ec None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:17.408885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:17.410043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:17.410322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:17.410596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.412309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:17.498521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:17.500226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fe2e-9f78-4126-9ce7-365c934960f0 service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:17.504185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:17.510727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 703/1400] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:46:18.092560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685644-8935-4b86-aa04-8531c6cce34a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.093072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685644-8935-4b86-aa04-8531c6cce34a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.093072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685644-8935-4b86-aa04-8531c6cce34a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.094427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 698/1401] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:18.100140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd116c9-fac7-453f-9ace-0b463ee9b247 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.100647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd116c9-fac7-453f-9ace-0b463ee9b247 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.100733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd116c9-fac7-453f-9ace-0b463ee9b247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.181578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4dd116c9-fac7-453f-9ace-0b463ee9b247 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:18.182958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4dd116c9-fac7-453f-9ace-0b463ee9b247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:18.333115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 704/1402] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:18.378923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685644-8935-4b86-aa04-8531c6cce34a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:18.380637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-91685644-8935-4b86-aa04-8531c6cce34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:18.566761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685644-8935-4b86-aa04-8531c6cce34a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:18.570212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:18.739823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:18.740550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:18.743035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:18.743035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:18.743242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:18.870294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:18.873360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ab1c-1c13-4cfa-b700-d50215b1df59 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:18.899081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 699/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:21.505180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420098a-68eb-46e7-8875-9cdd2eccde8a None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:21.506910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420098a-68eb-46e7-8875-9cdd2eccde8a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:21.507273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420098a-68eb-46e7-8875-9cdd2eccde8a None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:21.511873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 705/1404] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:21.514616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216a5a-8fc1-4eb7-b4d7-3066ff95b0e1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:21.515081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216a5a-8fc1-4eb7-b4d7-3066ff95b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:21.515169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216a5a-8fc1-4eb7-b4d7-3066ff95b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:21.526478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:21.607226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-83216a5a-8fc1-4eb7-b4d7-3066ff95b0e1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:21.608969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-83216a5a-8fc1-4eb7-b4d7-3066ff95b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:21.744288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 700/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:21.780572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420098a-68eb-46e7-8875-9cdd2eccde8a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:21.782540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4420098a-68eb-46e7-8875-9cdd2eccde8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:21.882356 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:21.971134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420098a-68eb-46e7-8875-9cdd2eccde8a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:22.101221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:22.101964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:22.102343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:22.102632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:22.104365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:22.154823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:22.218477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:22.220346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528501a3-cf13-44ac-bd73-4e71a40aa2ec service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:22.243789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 706/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:24.466350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8336ae-37af-4a8c-a4dc-b85858ce618c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:24.466959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8336ae-37af-4a8c-a4dc-b85858ce618c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:24.466959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8336ae-37af-4a8c-a4dc-b85858ce618c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:24.468316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 701/1407] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:24.474560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0ca7-a845-4dab-a444-da3972fbe165 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:24.475092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0ca7-a845-4dab-a444-da3972fbe165 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:24.475259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0ca7-a845-4dab-a444-da3972fbe165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:24.583443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-554b0ca7-a845-4dab-a444-da3972fbe165 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:24.583443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-554b0ca7-a845-4dab-a444-da3972fbe165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:24.748201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 707/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:46:24.794259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8336ae-37af-4a8c-a4dc-b85858ce618c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:24.795853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ef8336ae-37af-4a8c-a4dc-b85858ce618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:24.908660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:24.989664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8336ae-37af-4a8c-a4dc-b85858ce618c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:25.144922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:25.145614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:25.145958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:25.146508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:25.148302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:25.207135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:25.257498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:25.259112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc086c-7bf0-46c6-8b85-36fffae6355c service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:25.279676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 702/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:34.745866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:35.277302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=24 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:41.414533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1b68b-4158-4e2a-bf06-9cc1bedc0cef None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:41.415099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1b68b-4158-4e2a-bf06-9cc1bedc0cef None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:41.415099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1b68b-4158-4e2a-bf06-9cc1bedc0cef None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:41.416508 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 708/1410] 10.222.0.40 () {54 vars in 918 bytes} [Mon Jul 25 22:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:41.421612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d115b-a9d9-4b00-a744-8be27f278826 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:41.422045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d115b-a9d9-4b00-a744-8be27f278826 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:41.422156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d115b-a9d9-4b00-a744-8be27f278826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:41.499575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b95d115b-a9d9-4b00-a744-8be27f278826 None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:41.500859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b95d115b-a9d9-4b00-a744-8be27f278826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:41.611586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 703/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jul 25 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:46:41.626274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3227f0a-c495-4b2a-a583-8f9751e19a85 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:41.627096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3227f0a-c495-4b2a-a583-8f9751e19a85 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:41.627574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3227f0a-c495-4b2a-a583-8f9751e19a85 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:41.629004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 709/1412] 10.222.0.40 () {54 vars in 918 bytes} [Mon Jul 25 22:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:41.633987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2ba0-3a47-4fab-9c04-382050184b3d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:41.634280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2ba0-3a47-4fab-9c04-382050184b3d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:41.634563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2ba0-3a47-4fab-9c04-382050184b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:41.709080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:41.712216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fc9c2ba0-3a47-4fab-9c04-382050184b3d None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:41.713443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fc9c2ba0-3a47-4fab-9c04-382050184b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:41.833603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 704/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jul 25 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:44.319525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0972-a274-44e3-bb86-4eaad8e2b3bd None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:44.320094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0972-a274-44e3-bb86-4eaad8e2b3bd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:44.320094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0972-a274-44e3-bb86-4eaad8e2b3bd None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:44.321500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:44.326685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870edc7-ba2e-4bf8-9260-3dfccbbb50a6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:44.327144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870edc7-ba2e-4bf8-9260-3dfccbbb50a6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:44.327251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870edc7-ba2e-4bf8-9260-3dfccbbb50a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:44.394536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6870edc7-ba2e-4bf8-9260-3dfccbbb50a6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:44.396024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6870edc7-ba2e-4bf8-9260-3dfccbbb50a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:44.449945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:44.492831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:44.537757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e0972-a274-44e3-bb86-4eaad8e2b3bd None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:44.539502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-327e0972-a274-44e3-bb86-4eaad8e2b3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:44.695556 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e0972-a274-44e3-bb86-4eaad8e2b3bd None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:44.770210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:44.813887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:44.815209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:44.815496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:44.816257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:44.817527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:44.910548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:44.912192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87da80-853c-4c2c-834f-95089af6058d service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:44.930762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 711/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:45.913102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666f04-1709-48d3-8039-5ebe30716dc1 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:45.913692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666f04-1709-48d3-8039-5ebe30716dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:45.913692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666f04-1709-48d3-8039-5ebe30716dc1 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:45.915023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:45.920003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d0de9-b2eb-4f37-99de-2afd593079be None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:45.920449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d0de9-b2eb-4f37-99de-2afd593079be None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:45.920558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d0de9-b2eb-4f37-99de-2afd593079be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:45.998367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1d9d0de9-b2eb-4f37-99de-2afd593079be None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:45.999598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1d9d0de9-b2eb-4f37-99de-2afd593079be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:46.027843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:46.097029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:46.253393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666f04-1709-48d3-8039-5ebe30716dc1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:46.254943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a6666f04-1709-48d3-8039-5ebe30716dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:46.406847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666f04-1709-48d3-8039-5ebe30716dc1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:46.448177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:46.523261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:46.523858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:46.524158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:46.524439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:46.526126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:46.617638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:46.619596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8f20d-2289-4ac1-aedd-ea4ea238b8ca service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:46.637822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 707/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:47.524855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99693-05c1-4ab2-8f28-b5f8acfbcc39 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.525439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99693-05c1-4ab2-8f28-b5f8acfbcc39 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.525439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99693-05c1-4ab2-8f28-b5f8acfbcc39 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.526769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:47.532940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490bbe-a639-4b04-ba49-66a778ac1f1f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.533421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490bbe-a639-4b04-ba49-66a778ac1f1f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.533573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490bbe-a639-4b04-ba49-66a778ac1f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.595434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:47.618095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c0490bbe-a639-4b04-ba49-66a778ac1f1f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:47.619373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c0490bbe-a639-4b04-ba49-66a778ac1f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:47.727052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:47.881482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99693-05c1-4ab2-8f28-b5f8acfbcc39 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:47.883166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b8f99693-05c1-4ab2-8f28-b5f8acfbcc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:48.030276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99693-05c1-4ab2-8f28-b5f8acfbcc39 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:48.043033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:48.146394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:48.146942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:48.147235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:48.147516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:48.149447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:48.240973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:48.242607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0c50-f76d-4864-a481-8e719c914121 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:48.261459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 714/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:49.146059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5974e-700d-4223-aaed-76b4e9a0ba1b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:49.146648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5974e-700d-4223-aaed-76b4e9a0ba1b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:49.146648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5974e-700d-4223-aaed-76b4e9a0ba1b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:49.148001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:49.153162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d882-dcff-4f7d-b45a-f58cdfb38d07 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:49.153628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d882-dcff-4f7d-b45a-f58cdfb38d07 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:49.153741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9d882-dcff-4f7d-b45a-f58cdfb38d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:49.175104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:49.233334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4ec9d882-dcff-4f7d-b45a-f58cdfb38d07 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:49.234572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4ec9d882-dcff-4f7d-b45a-f58cdfb38d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:49.335914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:49.486770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5974e-700d-4223-aaed-76b4e9a0ba1b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:49.488334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-66b5974e-700d-4223-aaed-76b4e9a0ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:49.605187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:49.643781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5974e-700d-4223-aaed-76b4e9a0ba1b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:49.759962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:49.760511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:49.760794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:49.761071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:49.762742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:49.842553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:49.863487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:49.865147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1541ac-edf9-41d5-b4c0-cf61f9c789ea service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:49.884579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 710/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:50.773087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545df6-c86d-43ff-9fbc-f61888586801 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.773684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545df6-c86d-43ff-9fbc-f61888586801 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.773684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545df6-c86d-43ff-9fbc-f61888586801 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.775045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:50.781406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745f49-51a0-4a63-a7c0-eac4091cb900 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.781863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745f49-51a0-4a63-a7c0-eac4091cb900 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.781970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745f49-51a0-4a63-a7c0-eac4091cb900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.866919 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-21745f49-51a0-4a63-a7c0-eac4091cb900 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:50.868180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-21745f49-51a0-4a63-a7c0-eac4091cb900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:50.966302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:51.125116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545df6-c86d-43ff-9fbc-f61888586801 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:51.127451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bd545df6-c86d-43ff-9fbc-f61888586801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:51.211133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:51.274687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545df6-c86d-43ff-9fbc-f61888586801 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:51.390554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:51.391094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:51.391385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:51.392319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:51.393978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:51.443412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:51.484595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:51.486716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87e5c-4823-44dc-b9d9-5a9dc6c11684 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:51.505596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 717/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:52.374510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f1adc-d98f-4c32-9520-4af52ec480c5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.374983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f1adc-d98f-4c32-9520-4af52ec480c5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.375077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f1adc-d98f-4c32-9520-4af52ec480c5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.377228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:52.382428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c7c64-188b-4332-8a3c-43222ce42874 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.382870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c7c64-188b-4332-8a3c-43222ce42874 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.382983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c7c64-188b-4332-8a3c-43222ce42874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.461380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d30c7c64-188b-4332-8a3c-43222ce42874 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:52.462610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d30c7c64-188b-4332-8a3c-43222ce42874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:52.560611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:52.712024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f1adc-d98f-4c32-9520-4af52ec480c5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:52.713618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-eb7f1adc-d98f-4c32-9520-4af52ec480c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:52.763298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:52.864855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f1adc-d98f-4c32-9520-4af52ec480c5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:52.980776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:52.981402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.981682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.981954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.983600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:52.992867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.081689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.083292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9349f-6ce3-4e2a-a01e-c2e18d7a1d85 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.104353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 713/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:53.997332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e955de-88fb-4358-a371-9888ce596a6a None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.997900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e955de-88fb-4358-a371-9888ce596a6a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.997900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e955de-88fb-4358-a371-9888ce596a6a None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.999597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:54.005740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e0a6-b571-46d9-8c2d-0877324633ae None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:54.006294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e0a6-b571-46d9-8c2d-0877324633ae None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:54.006417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e0a6-b571-46d9-8c2d-0877324633ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:54.090705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0f81e0a6-b571-46d9-8c2d-0877324633ae None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:54.091998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0f81e0a6-b571-46d9-8c2d-0877324633ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:54.160864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:54.190128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:54.342021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e955de-88fb-4358-a371-9888ce596a6a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:54.343546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-38e955de-88fb-4358-a371-9888ce596a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:54.362863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:54.492951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e955de-88fb-4358-a371-9888ce596a6a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:54.581849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:54.608169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:54.608814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:54.609095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:54.609368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:54.611127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:54.700493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:54.702101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dd9af-34a6-4548-ab97-6aec1a20ffe9 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:54.721089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 720/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:55.591452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a9af1-a299-4028-8406-79622c2369c8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.591998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a9af1-a299-4028-8406-79622c2369c8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.591998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a9af1-a299-4028-8406-79622c2369c8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.593345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:55.598604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f225-9fc0-42b1-b406-2c8157b8bf89 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.599061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f225-9fc0-42b1-b406-2c8157b8bf89 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.599159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f225-9fc0-42b1-b406-2c8157b8bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.677342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5f40f225-9fc0-42b1-b406-2c8157b8bf89 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:55.678588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5f40f225-9fc0-42b1-b406-2c8157b8bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:55.842639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:55.898178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:56.050305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a9af1-a299-4028-8406-79622c2369c8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.051869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-273a9af1-a299-4028-8406-79622c2369c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.207303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a9af1-a299-4028-8406-79622c2369c8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.263951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.326313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.326942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.327231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.327513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.329837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.424936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.426544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6fa5-fa66-4b65-9fc8-0b1af1129d78 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.444978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 716/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:46:57.325828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb6eb-6466-4787-af3c-6a6978ae3c17 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.326692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb6eb-6466-4787-af3c-6a6978ae3c17 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.326876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb6eb-6466-4787-af3c-6a6978ae3c17 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.328350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:57.334366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a952-3792-4129-9590-695b8eec6d6c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.334845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a952-3792-4129-9590-695b8eec6d6c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.334938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a952-3792-4129-9590-695b8eec6d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.414122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a575a952-3792-4129-9590-695b8eec6d6c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:57.415362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a575a952-3792-4129-9590-695b8eec6d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:57.417502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.518899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:57.671474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cb6eb-6466-4787-af3c-6a6978ae3c17 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.673848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-817cb6eb-6466-4787-af3c-6a6978ae3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:57.824401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cb6eb-6466-4787-af3c-6a6978ae3c17 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.852262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.941257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.941789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.942074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.942345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.944007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:58.034936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:58.036581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887095e-e35d-4bd4-9e9d-44d9c0b4e1b9 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:58.056005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 723/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:59.989657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fec2e-ff73-4666-bd55-4b35e6960beb None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:59.990213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fec2e-ff73-4666-bd55-4b35e6960beb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:59.990213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fec2e-ff73-4666-bd55-4b35e6960beb None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:59.991698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:59.997125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d1ec5-151d-4f83-8905-013b6bc07ad0 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:59.997622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d1ec5-151d-4f83-8905-013b6bc07ad0 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:59.997774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d1ec5-151d-4f83-8905-013b6bc07ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.045954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:00.077839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-fd9d1ec5-151d-4f83-8905-013b6bc07ad0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:00.079183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fd9d1ec5-151d-4f83-8905-013b6bc07ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:00.180957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:00.221642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fec2e-ff73-4666-bd55-4b35e6960beb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:00.223352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d77fec2e-ff73-4666-bd55-4b35e6960beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:00.331841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fec2e-ff73-4666-bd55-4b35e6960beb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:00.365064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:00.409584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:00.410207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.410493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.410773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.412459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:00.524336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:00.525792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d071332-e3d3-4def-be86-180e4eb57fc9 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:00.545926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 719/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:02.761604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983855c-c670-4fc6-9c27-5f43724e5ee8 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:02.762230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983855c-c670-4fc6-9c27-5f43724e5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:02.762230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983855c-c670-4fc6-9c27-5f43724e5ee8 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:02.763511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:02.769674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2827b-1ab4-4dcf-98f1-19f7f3d8b624 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:02.770447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2827b-1ab4-4dcf-98f1-19f7f3d8b624 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:02.770567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2827b-1ab4-4dcf-98f1-19f7f3d8b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:02.840970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e7b2827b-1ab4-4dcf-98f1-19f7f3d8b624 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:02.842214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e7b2827b-1ab4-4dcf-98f1-19f7f3d8b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:02.856516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:02.944283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:02.985371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983855c-c670-4fc6-9c27-5f43724e5ee8 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:02.986911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c983855c-c670-4fc6-9c27-5f43724e5ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:03.093558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983855c-c670-4fc6-9c27-5f43724e5ee8 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:03.106053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:03.169811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:03.170432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.170717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.170988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.172822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:03.283045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:03.284530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d2fa2-c28d-4820-92ae-a501afdfef00 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:03.303261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 726/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:05.749641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c19cc-4648-4928-9d4f-1a2e6253aab8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:05.750260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c19cc-4648-4928-9d4f-1a2e6253aab8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:05.750260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c19cc-4648-4928-9d4f-1a2e6253aab8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:05.752007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:05.757371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27958-f9f9-4913-9db5-dc4a598bfc92 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:05.757819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27958-f9f9-4913-9db5-dc4a598bfc92 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:05.757923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27958-f9f9-4913-9db5-dc4a598bfc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:05.823105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:05.847417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b6f27958-f9f9-4913-9db5-dc4a598bfc92 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:05.848674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b6f27958-f9f9-4913-9db5-dc4a598bfc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:05.951231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:05.992301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c19cc-4648-4928-9d4f-1a2e6253aab8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:05.993963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ec8c19cc-4648-4928-9d4f-1a2e6253aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:06.102586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c19cc-4648-4928-9d4f-1a2e6253aab8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:06.144529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:06.179723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:06.180384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:06.180671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:06.180948 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:06.182608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:06.297734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:06.299188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13590c-8757-402e-ba74-d17764e40ff5 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:06.320101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 722/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:08.515173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c5e7-0b6d-43ed-b2a3-83d5798af98b None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.515836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c5e7-0b6d-43ed-b2a3-83d5798af98b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.515836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c5e7-0b6d-43ed-b2a3-83d5798af98b None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.517208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:08.522955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613bf6a-1022-4dc9-a14b-a134725c2029 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.523391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613bf6a-1022-4dc9-a14b-a134725c2029 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.523560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613bf6a-1022-4dc9-a14b-a134725c2029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.593269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3613bf6a-1022-4dc9-a14b-a134725c2029 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:08.594975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3613bf6a-1022-4dc9-a14b-a134725c2029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:08.616723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.697095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:08.736745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c5e7-0b6d-43ed-b2a3-83d5798af98b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.738304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ec98c5e7-0b6d-43ed-b2a3-83d5798af98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:08.842165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c5e7-0b6d-43ed-b2a3-83d5798af98b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.862164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.923691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.924342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.924622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.924894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.926531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:09.046090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.048202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70524c-7e83-4376-9178-f12d40ec101a service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.066268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 729/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:11.189667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68a62e-c802-4ef5-8229-8095b7d8133f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:11.190242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68a62e-c802-4ef5-8229-8095b7d8133f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:11.190343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68a62e-c802-4ef5-8229-8095b7d8133f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:11.191682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:11.197326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae18f42-bd9f-4943-abff-e61b0eb1f9a9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:11.197757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae18f42-bd9f-4943-abff-e61b0eb1f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:11.197899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae18f42-bd9f-4943-abff-e61b0eb1f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:11.263552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:11.266970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-7ae18f42-bd9f-4943-abff-e61b0eb1f9a9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:11.268248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7ae18f42-bd9f-4943-abff-e61b0eb1f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:11.368423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:11.408571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68a62e-c802-4ef5-8229-8095b7d8133f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:11.410149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ee68a62e-c802-4ef5-8229-8095b7d8133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:11.522253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68a62e-c802-4ef5-8229-8095b7d8133f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:11.573864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:11.600400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:11.601101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:11.601397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:11.601679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:11.603397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:11.716393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:11.717841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a832b5d-c1ad-4616-8485-b4537c5591a6 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:11.737994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 725/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:47:13.845336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f122e-15a4-4c19-8bf8-65662c308199 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.845954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f122e-15a4-4c19-8bf8-65662c308199 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.845954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f122e-15a4-4c19-8bf8-65662c308199 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.847311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:13.853299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9cbd-44c9-4e82-9f30-a1c6f46fb823 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.853880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9cbd-44c9-4e82-9f30-a1c6f46fb823 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.853880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9cbd-44c9-4e82-9f30-a1c6f46fb823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.931186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ecba9cbd-44c9-4e82-9f30-a1c6f46fb823 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:13.932752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ecba9cbd-44c9-4e82-9f30-a1c6f46fb823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:14.088947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.160362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:14.200680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f122e-15a4-4c19-8bf8-65662c308199 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.202234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-544f122e-15a4-4c19-8bf8-65662c308199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:14.311613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f122e-15a4-4c19-8bf8-65662c308199 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.340754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.386893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.387516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.387835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.388116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.389777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:14.502543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.503947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a81bd8-fc3b-41e7-a463-b6f45ee56361 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.522816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 732/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:16.645099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4787c-be3a-4e89-a6db-a1e3e4cd746c None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.645643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4787c-be3a-4e89-a6db-a1e3e4cd746c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.645643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4787c-be3a-4e89-a6db-a1e3e4cd746c None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.647040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:16.652548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36d69-dba9-4a3d-867a-56ef890c020c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.652977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36d69-dba9-4a3d-867a-56ef890c020c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.653209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36d69-dba9-4a3d-867a-56ef890c020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.721208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-93c36d69-dba9-4a3d-867a-56ef890c020c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:16.722455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-93c36d69-dba9-4a3d-867a-56ef890c020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:16.731024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:16.823285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:16.861998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4787c-be3a-4e89-a6db-a1e3e4cd746c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:16.863604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-30f4787c-be3a-4e89-a6db-a1e3e4cd746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:16.981227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4787c-be3a-4e89-a6db-a1e3e4cd746c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:17.044717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:17.066094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:17.073585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:17.073585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:17.073585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:17.073585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:17.192924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:17.194356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf265e4-2d88-415e-a71e-00332b3a0f52 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:17.212769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 728/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:19.353654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8896-469e-4c8f-b409-5dc1fe4029ab None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.354234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8896-469e-4c8f-b409-5dc1fe4029ab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.354234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8896-469e-4c8f-b409-5dc1fe4029ab None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.355606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:19.362019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac1b9-a900-4b88-9936-4c386c0de7d9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.362551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac1b9-a900-4b88-9936-4c386c0de7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.362551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac1b9-a900-4b88-9936-4c386c0de7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.431010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1feac1b9-a900-4b88-9936-4c386c0de7d9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:19.432279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1feac1b9-a900-4b88-9936-4c386c0de7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:19.476881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:19.542940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:47:19.581334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f8896-469e-4c8f-b409-5dc1fe4029ab None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:19.582902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aa0f8896-469e-4c8f-b409-5dc1fe4029ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:19.691033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f8896-469e-4c8f-b409-5dc1fe4029ab None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:19.731121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:19.767526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:19.768374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.769060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.769595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.771247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:19.883227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:19.884729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750ae75-b3f6-4ee2-9419-2f02cabb8fb6 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:19.903979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 735/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:21.946301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6d74-1082-4ebe-b881-f40af239d845 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.946879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6d74-1082-4ebe-b881-f40af239d845 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.946879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6d74-1082-4ebe-b881-f40af239d845 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:21.948269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:21.953631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5118e7-c2f7-41d7-9031-04c0a0fdc5ba None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.954602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5118e7-c2f7-41d7-9031-04c0a0fdc5ba None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.954756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5118e7-c2f7-41d7-9031-04c0a0fdc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.025132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bf5118e7-c2f7-41d7-9031-04c0a0fdc5ba None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:22.026381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bf5118e7-c2f7-41d7-9031-04c0a0fdc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:22.045297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.125909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:22.163644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6d74-1082-4ebe-b881-f40af239d845 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.165226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7cbe6d74-1082-4ebe-b881-f40af239d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:22.277179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6d74-1082-4ebe-b881-f40af239d845 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.347436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.354498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.355124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.355412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.355692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.357411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:22.471803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.473178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3a2e4-4d82-45e9-ace8-8d75cd6ffc20 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.492228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 731/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:24.550600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682108-548c-42a1-b806-d1bb08ee8292 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.551189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682108-548c-42a1-b806-d1bb08ee8292 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.551189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682108-548c-42a1-b806-d1bb08ee8292 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.552622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:24.558084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e439a-e84a-4ee4-a8f3-e50b7aaa8dd0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.558548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e439a-e84a-4ee4-a8f3-e50b7aaa8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.558695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e439a-e84a-4ee4-a8f3-e50b7aaa8dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.629564 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f69e439a-e84a-4ee4-a8f3-e50b7aaa8dd0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:24.630793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f69e439a-e84a-4ee4-a8f3-e50b7aaa8dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:24.685183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.738114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:24.776120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682108-548c-42a1-b806-d1bb08ee8292 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.777655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d2682108-548c-42a1-b806-d1bb08ee8292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:24.885199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682108-548c-42a1-b806-d1bb08ee8292 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.933121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.960547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.961167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.961448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.961720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.963404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:25.074747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.076212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88051242-49d0-449c-8121-6f1885aa8cdd service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.094981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 738/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:34.736242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=22 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.092277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=66 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:45.130325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bef90-4c1f-41e9-b898-318ab1deb3ec None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:45.130986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bef90-4c1f-41e9-b898-318ab1deb3ec None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:45.130986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bef90-4c1f-41e9-b898-318ab1deb3ec None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:45.132343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 733/1471] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:45.137393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ddb37-2b3b-4589-9b27-60af9a1188ed None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:45.137799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ddb37-2b3b-4589-9b27-60af9a1188ed None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:45.137938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ddb37-2b3b-4589-9b27-60af9a1188ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:45.205994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e73ddb37-2b3b-4589-9b27-60af9a1188ed None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:45.207224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e73ddb37-2b3b-4589-9b27-60af9a1188ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:45.304043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 739/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:45.387691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec647e7-3854-4bd4-baf9-b9ed7f690542 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:45.388014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec647e7-3854-4bd4-baf9-b9ed7f690542 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:45.388293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec647e7-3854-4bd4-baf9-b9ed7f690542 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:45.390547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 734/1473] 10.222.0.40 () {54 vars in 966 bytes} [Mon Jul 25 22:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:45.395951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08157e11-257e-4228-8996-1ee58220e57a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:45.396253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08157e11-257e-4228-8996-1ee58220e57a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:45.396533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08157e11-257e-4228-8996-1ee58220e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:45.471846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-08157e11-257e-4228-8996-1ee58220e57a None None] MFA Rules not processed for user `e9a8f7e27170404ebf1a2be70efe63fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:45.473075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-08157e11-257e-4228-8996-1ee58220e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:45.496470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:45.552813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 740/1474] 10.222.0.40 () {58 vars in 1063 bytes} [Mon Jul 25 22:47:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:45.561271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec647e7-3854-4bd4-baf9-b9ed7f690542 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:45.563484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-eec647e7-3854-4bd4-baf9-b9ed7f690542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:45.669717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec647e7-3854-4bd4-baf9-b9ed7f690542 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:45.744570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:45.745199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:45.745482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:45.745755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:45.747442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:45.803517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:45.860578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:45.862035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b12e19-a413-4815-bb40-b39e1cea6a83 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:45.881240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 735/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:48.059689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c9ef5-6b63-4ad5-903b-6dd8e10ddd71 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.060810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c9ef5-6b63-4ad5-903b-6dd8e10ddd71 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.060936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c9ef5-6b63-4ad5-903b-6dd8e10ddd71 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.062303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 741/1476] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:48.067938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0396-16c1-4306-9954-f80d9fcf4f3c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.068439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0396-16c1-4306-9954-f80d9fcf4f3c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.068543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0396-16c1-4306-9954-f80d9fcf4f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.146584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6f2d0396-16c1-4306-9954-f80d9fcf4f3c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:48.147934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6f2d0396-16c1-4306-9954-f80d9fcf4f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:48.262835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 736/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:48.291666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c9ef5-6b63-4ad5-903b-6dd8e10ddd71 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.294041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f87c9ef5-6b63-4ad5-903b-6dd8e10ddd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:48.494248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c9ef5-6b63-4ad5-903b-6dd8e10ddd71 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.587244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.642840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.643629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.643946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.644216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.644921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.647281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:47:48.647281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:47:48.647281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:47:48.648892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4929200-4646-4a1b-ac3e-72d4a2e839c8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.672476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 742/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/projects => generated 2553 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:47:50.848876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928300-c4bb-4a2d-b573-69b7fb6d65e5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.849478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928300-c4bb-4a2d-b573-69b7fb6d65e5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.849478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928300-c4bb-4a2d-b573-69b7fb6d65e5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.850991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 737/1479] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:50.856918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338fe15-94b2-4a71-8eee-a152c8e70f08 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.857634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338fe15-94b2-4a71-8eee-a152c8e70f08 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.857823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338fe15-94b2-4a71-8eee-a152c8e70f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.929459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e338fe15-94b2-4a71-8eee-a152c8e70f08 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:50.930731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e338fe15-94b2-4a71-8eee-a152c8e70f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:51.039816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 743/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:47:51.086265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928300-c4bb-4a2d-b573-69b7fb6d65e5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:51.088025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ef928300-c4bb-4a2d-b573-69b7fb6d65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:51.099216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:51.264812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928300-c4bb-4a2d-b573-69b7fb6d65e5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:51.364566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:51.407454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:51.408101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:51.408380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:51.408665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:51.410298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:51.507049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:51.508711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3574dfa-193a-410a-9e73-2ae1ceb13137 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:51.528656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 738/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:53.791155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e65b0-b90c-45ce-ba38-424180926966 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.791722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e65b0-b90c-45ce-ba38-424180926966 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.791722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e65b0-b90c-45ce-ba38-424180926966 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.793141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 744/1482] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:53.799330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0f05-e374-497b-adf7-cf99d54e0275 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.799861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0f05-e374-497b-adf7-cf99d54e0275 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.799995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0f05-e374-497b-adf7-cf99d54e0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.867177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6bca0f05-e374-497b-adf7-cf99d54e0275 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:53.868473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6bca0f05-e374-497b-adf7-cf99d54e0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:53.916089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.968598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 739/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:54.006472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e65b0-b90c-45ce-ba38-424180926966 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.008073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ba1e65b0-b90c-45ce-ba38-424180926966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:54.033471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.122236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e65b0-b90c-45ce-ba38-424180926966 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.209195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.209840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.210132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.210441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.212280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:54.305542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.344194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.345655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8bdd6-0883-4be2-8fca-ad6b7bcc0361 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.366604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 745/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:56.460264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63122ebc-9d2d-49f3-a3a6-b95a7c98e42e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.460838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63122ebc-9d2d-49f3-a3a6-b95a7c98e42e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.460838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63122ebc-9d2d-49f3-a3a6-b95a7c98e42e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.462217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 740/1485] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:56.468703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba8c03-24d5-45bd-b782-03febe2d0b26 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.469199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba8c03-24d5-45bd-b782-03febe2d0b26 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.469322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba8c03-24d5-45bd-b782-03febe2d0b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.538986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bdba8c03-24d5-45bd-b782-03febe2d0b26 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:56.540257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bdba8c03-24d5-45bd-b782-03febe2d0b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:56.651414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 746/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:56.690191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63122ebc-9d2d-49f3-a3a6-b95a7c98e42e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:56.691730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-63122ebc-9d2d-49f3-a3a6-b95a7c98e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:56.800066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63122ebc-9d2d-49f3-a3a6-b95a7c98e42e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:56.876674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:56.878580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:56.879205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.879488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.879786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.881414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:56.996582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:56.998526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f03500-8f55-4678-999f-313f378e8ba4 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:57.017387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 741/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:59.133654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c8ed4-48cf-410d-a265-cf27ddff9520 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.134214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c8ed4-48cf-410d-a265-cf27ddff9520 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.134395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c8ed4-48cf-410d-a265-cf27ddff9520 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.135648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 747/1488] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:59.141210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0953-7596-4045-9d70-959dd11c9900 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.141680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0953-7596-4045-9d70-959dd11c9900 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.141794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0953-7596-4045-9d70-959dd11c9900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.210642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b99a0953-7596-4045-9d70-959dd11c9900 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:59.211894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b99a0953-7596-4045-9d70-959dd11c9900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:59.266132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.312412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 742/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:59.353100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c8ed4-48cf-410d-a265-cf27ddff9520 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.354639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d71c8ed4-48cf-410d-a265-cf27ddff9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:59.397646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.463027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c8ed4-48cf-410d-a265-cf27ddff9520 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.539321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.539974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.540259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.540526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.542163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:59.626024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.659720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.661140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80702f-adcc-4961-aef6-152b4dfefe26 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.680159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 748/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:48:02.140432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb1b8-90bd-4a68-b6c6-aca947c0a0bc None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.140981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb1b8-90bd-4a68-b6c6-aca947c0a0bc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.140981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb1b8-90bd-4a68-b6c6-aca947c0a0bc None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.142391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 743/1491] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 25 22:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:02.148031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ac38-2169-44f4-8331-27dc3f1355ab None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.148517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ac38-2169-44f4-8331-27dc3f1355ab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.148656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ac38-2169-44f4-8331-27dc3f1355ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.214894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4403ac38-2169-44f4-8331-27dc3f1355ab None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:02.216752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4403ac38-2169-44f4-8331-27dc3f1355ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:02.316817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 749/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:48:02.359583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb1b8-90bd-4a68-b6c6-aca947c0a0bc None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:02.361168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d06cb1b8-90bd-4a68-b6c6-aca947c0a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:02.467432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb1b8-90bd-4a68-b6c6-aca947c0a0bc None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:02.542192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:02.542816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.543108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.543387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.546032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:02.555992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:02.660044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:02.661479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580305b-0a4f-4d09-9c2a-222dae2fea51 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:02.680279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 744/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:48:12.314842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=82 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.677860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=50 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:40.942343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:40.942968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:40.942968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:41.025780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:49:41.027025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:41.124748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 750/1494] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:49:41.133033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:41.133567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:41.133674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:41.210667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:49:41.211903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:41.308647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 745/1495] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:49:41.313861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:41.315083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:41.327308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6d20e-c732-4a3d-bdca-babb3fd98be5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:41.388283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:41.422841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:41.423471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:41.423778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:41.424062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:41.424762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:49:41.425066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:41.426088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:41.426088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:49:41.426088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:49:41.426977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:41.440874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 751/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:49:41.449481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:41.459658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4f2f4-78ca-4148-b25e-a5afae8614ae None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:41.525080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:41.559996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:41.560552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:41.561663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:41.561962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:41.562647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:41.564436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:41.564436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:49:41.564436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:49:41.565634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:41.684828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 746/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:49:41 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:49:41.689879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:41.691402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:41.725811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf856b-d95c-415b-a4ab-d72f1663f1a4 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:41.823345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:41.823921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:41.824207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:41.824487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:41.825152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:41.826171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:41.826171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:49:41.826171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:49:41.828357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:41.929188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 752/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:49:41 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:49:41.933445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:41.935891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:41.998115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a9ee-fa1f-43be-afb8-a4f6b331d9d2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:42.085714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:42.097432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:42.098115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:42.098403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:42.098683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:42.099395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:42.100480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:42.100480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:49:42.100480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:49:42.101384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:42.114877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 747/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:49:42.119367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:42.121088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:42.132842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1b043-8dae-45fc-a3b9-fa7fdac58e3c admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:42.159206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:42.232787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:42.233411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:42.233719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:42.234026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:42.234733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:42.235745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:42.235745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:49:42.235745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:49:42.236671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bec6e-80d1-4ad4-be55-c3bf078a5bc8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:42.249145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 753/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:49:42.253590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:42.255123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:42.289949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200ba9-0f12-4c03-81d4-0f6968304cd1 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:42.384573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:42.385237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:42.385516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:42.385788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] PATH_INFO: `/v3/projects/60536ee665844f63825ebba5bacf8b22/users/fdb6b392f31a4119935d79a279573030/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:42.408241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60536ee665844f63825ebba5bacf8b22, user_id=fdb6b392f31a4119935d79a279573030, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:42.409274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:42.409274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:49:42.409274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:49:42.411206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799ae3b-f093-431c-a0f2-65bb5aed7fb0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:42.518073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 748/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:49:42 2022] PUT /identity/v3/projects/60536ee665844f63825ebba5bacf8b22/users/fdb6b392f31a4119935d79a279573030/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:49:42.530360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b23b16-723f-48ad-8ce5-0e2cdf4ef132 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:42.530799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b23b16-723f-48ad-8ce5-0e2cdf4ef132 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:42.531207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b23b16-723f-48ad-8ce5-0e2cdf4ef132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:42.588368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-91b23b16-723f-48ad-8ce5-0e2cdf4ef132 None None] MFA Rules not processed for user `fdb6b392f31a4119935d79a279573030`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:49:42.589604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-91b23b16-723f-48ad-8ce5-0e2cdf4ef132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:42.668447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 754/1502] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:49:42.682541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae8c0-81d9-43fc-bb76-401db3bf2f6a None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:42.682866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae8c0-81d9-43fc-bb76-401db3bf2f6a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:42.683157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae8c0-81d9-43fc-bb76-401db3bf2f6a None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:42.684553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 749/1503] 10.222.0.40 () {54 vars in 964 bytes} [Mon Jul 25 22:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:49:42.689348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f7607-06f4-4179-8df0-70c7ac9f8edd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:42.689636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f7607-06f4-4179-8df0-70c7ac9f8edd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:42.689921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f7607-06f4-4179-8df0-70c7ac9f8edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:42.721840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:42.773194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-729f7607-06f4-4179-8df0-70c7ac9f8edd None None] MFA Rules not processed for user `4957fb8ec82d40f985b586cda019a0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:49:42.774441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-729f7607-06f4-4179-8df0-70c7ac9f8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:42.854081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 755/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Jul 25 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:49:42.862635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae8c0-81d9-43fc-bb76-401db3bf2f6a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:42.864328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-66dae8c0-81d9-43fc-bb76-401db3bf2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:42.915877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:42.970790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae8c0-81d9-43fc-bb76-401db3bf2f6a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:43.044642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:43.045267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:43.045563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:43.045836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:43.047517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:43.149844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:43.151293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:43.154902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:43.172378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 750/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:49:43.217572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b498e-c6ee-4cfa-96c8-83c60508c0bd None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:43.218099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b498e-c6ee-4cfa-96c8-83c60508c0bd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:43.218808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b498e-c6ee-4cfa-96c8-83c60508c0bd None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:43.220386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 756/1506] 10.222.0.40 () {52 vars in 830 bytes} [Mon Jul 25 22:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:49:43.224112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:43.225298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:43.326164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2e1bc-4585-4227-bdd3-97df55c82e10 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:43.420955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:43.421600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:43.421874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:43.422144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] PATH_INFO: `/v3/users/fdb6b392f31a4119935d79a279573030` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:43.434187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb6b392f31a4119935d79a279573030)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:43.435207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:43.435207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:49:43.435207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:49:43.436452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:43.446742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:43.625690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb6b392f31a4119935d79a279573030'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:43.626231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb6b392f31a4119935d79a279573030'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:43.688014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb6b392f31a4119935d79a279573030'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:43.688510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb6b392f31a4119935d79a279573030'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:43.707696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb6b392f31a4119935d79a279573030'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:43.725628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 751/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:49:43 2022] DELETE /identity/v3/users/fdb6b392f31a4119935d79a279573030 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:49:43.730180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:43.730483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:43.730748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:43.792016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:49:43.793224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:43.879698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:43.894478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 757/1508] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:49:43.904901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:43.906381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:44.009216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8bda-5263-498b-8dd7-187c32fc5439 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:44.064766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:44.083725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:44.084378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:44.084665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:44.084942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:44.086588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:44.202343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:44.203687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38460c-bef7-4207-b0d9-3c24f9184b9c service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:44.223099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 752/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:49:44.672487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:44.674013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:44.686206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14798f-57bf-4afa-a62c-f8f92014a3a7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:44.692192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:44.693203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:44.693494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:44.693772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] PATH_INFO: `/v3/projects/60536ee665844f63825ebba5bacf8b22` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:44.706459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60536ee665844f63825ebba5bacf8b22)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:44.707424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:49:44.707424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:49:44.707424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:49:44.708671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:44.831739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60536ee665844f63825ebba5bacf8b22', 'request_id': 'req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:44.845862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60536ee665844f63825ebba5bacf8b22', 'request_id': 'req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:44.851942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60536ee665844f63825ebba5bacf8b22', 'request_id': 'req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:44.944524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] The token cache is being invalidate because project 60536ee665844f63825ebba5bacf8b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:49:44.944814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:44.945441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c5d8dd7-6b3d-4855-af99-ba07d1ae4655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:49:44.947087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 758/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:49:44 2022] DELETE /identity/v3/projects/60536ee665844f63825ebba5bacf8b22 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:49:54.220813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=62 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:54.941257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:33.964312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfc873-bb69-4d60-8965-81b1d5047c45 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:33.965437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfc873-bb69-4d60-8965-81b1d5047c45 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:33.965594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfc873-bb69-4d60-8965-81b1d5047c45 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:33.966988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:33.971993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85ad03-2311-42af-96ba-da21390075b4 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:33.972439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85ad03-2311-42af-96ba-da21390075b4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:33.972572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85ad03-2311-42af-96ba-da21390075b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:34.023238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-2e85ad03-2311-42af-96ba-da21390075b4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:34.024559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2e85ad03-2311-42af-96ba-da21390075b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:34.085392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:34.248310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfc873-bb69-4d60-8965-81b1d5047c45 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:34.250348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b0dfc873-bb69-4d60-8965-81b1d5047c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:34.377368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfc873-bb69-4d60-8965-81b1d5047c45 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:34.383026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6be63-f6f1-4beb-9201-b726cb3cb8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:34.383680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6be63-f6f1-4beb-9201-b726cb3cb8f3 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:34.384001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6be63-f6f1-4beb-9201-b726cb3cb8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:34.384538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6be63-f6f1-4beb-9201-b726cb3cb8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:34.392878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6be63-f6f1-4beb-9201-b726cb3cb8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:34.394470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6be63-f6f1-4beb-9201-b726cb3cb8f3 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:34.404290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 754/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:35.247779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5a796-c58f-485f-ab00-511d719b1e21 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:35.248405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5a796-c58f-485f-ab00-511d719b1e21 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:35.248405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5a796-c58f-485f-ab00-511d719b1e21 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:35.249773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:35.254654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de83f-659f-4883-8147-88f97fb000ca None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:35.255108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de83f-659f-4883-8147-88f97fb000ca None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:35.255248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de83f-659f-4883-8147-88f97fb000ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:35.274696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-143de83f-659f-4883-8147-88f97fb000ca None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:35.275956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-143de83f-659f-4883-8147-88f97fb000ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:35.284128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:35.437985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5a796-c58f-485f-ab00-511d719b1e21 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:35.452948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5a796-c58f-485f-ab00-511d719b1e21 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:35.459333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f60ac5-fdd4-4ca3-bf46-b5a3092be3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:35.460187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f60ac5-fdd4-4ca3-bf46-b5a3092be3c2 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:35.460605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f60ac5-fdd4-4ca3-bf46-b5a3092be3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:35.461002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f60ac5-fdd4-4ca3-bf46-b5a3092be3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:35.472063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f60ac5-fdd4-4ca3-bf46-b5a3092be3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:35.473732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f60ac5-fdd4-4ca3-bf46-b5a3092be3c2 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:35.485499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 761/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:51:35.735561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b51-936b-424c-9347-dea8f0b5f356 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:35.735879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b51-936b-424c-9347-dea8f0b5f356 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:35.736194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b51-936b-424c-9347-dea8f0b5f356 None None] PATH_INFO: `/v3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:35.737477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 756/1517] 10.222.0.36 () {54 vars in 925 bytes} [Mon Jul 25 22:51:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:51:35.744119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287f42-9270-4738-aea3-12a1c53c4aa3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:35.744441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287f42-9270-4738-aea3-12a1c53c4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:35.744722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287f42-9270-4738-aea3-12a1c53c4aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:35.805437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bc287f42-9270-4738-aea3-12a1c53c4aa3 None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:35.806585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bc287f42-9270-4738-aea3-12a1c53c4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:35.881136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 762/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jul 25 22:51:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:39.956293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808b9c5-4db3-43d7-a49e-c49041977074 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:39.956867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808b9c5-4db3-43d7-a49e-c49041977074 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:39.956867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808b9c5-4db3-43d7-a49e-c49041977074 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:39.958094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 757/1519] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jul 25 22:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:39.963148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e655f0-b927-4c5f-84e0-be3b53098218 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:39.963567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e655f0-b927-4c5f-84e0-be3b53098218 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:39.963711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e655f0-b927-4c5f-84e0-be3b53098218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:39.983772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-62e655f0-b927-4c5f-84e0-be3b53098218 None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:39.985940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-62e655f0-b927-4c5f-84e0-be3b53098218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:39.994630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 763/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jul 25 22:51:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:40.002760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808b9c5-4db3-43d7-a49e-c49041977074 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:40.016568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808b9c5-4db3-43d7-a49e-c49041977074 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:40.021481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a13e-238a-4d9f-9a06-cb3d61de965f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:40.022081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a13e-238a-4d9f-9a06-cb3d61de965f service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:40.022365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a13e-238a-4d9f-9a06-cb3d61de965f service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:40.022639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a13e-238a-4d9f-9a06-cb3d61de965f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:40.030914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a13e-238a-4d9f-9a06-cb3d61de965f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:40.033106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a13e-238a-4d9f-9a06-cb3d61de965f service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:40.043431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 758/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:46.723457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a405a5-d108-4632-9e3c-ed3ac2f33d47 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:46.724052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a405a5-d108-4632-9e3c-ed3ac2f33d47 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:46.724052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a405a5-d108-4632-9e3c-ed3ac2f33d47 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:46.725465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:46.730413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d04d0-cefb-4fdc-868a-37b23d5c0c74 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:46.730863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d04d0-cefb-4fdc-868a-37b23d5c0c74 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:46.730969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d04d0-cefb-4fdc-868a-37b23d5c0c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:46.750594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6e6d04d0-cefb-4fdc-868a-37b23d5c0c74 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:46.751842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6e6d04d0-cefb-4fdc-868a-37b23d5c0c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:46.760305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:46.917964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a405a5-d108-4632-9e3c-ed3ac2f33d47 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:46.932927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a405a5-d108-4632-9e3c-ed3ac2f33d47 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:46.938446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7168-c02d-4947-abe9-d2988a2f7385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:46.939136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7168-c02d-4947-abe9-d2988a2f7385 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:46.939386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7168-c02d-4947-abe9-d2988a2f7385 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:46.939709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7168-c02d-4947-abe9-d2988a2f7385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:46.948338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7168-c02d-4947-abe9-d2988a2f7385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:46.950035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7168-c02d-4947-abe9-d2988a2f7385 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:46.953997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:46.960600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 765/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:47.789775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a34d-f7fd-45eb-bdf8-850624c4a59f None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:47.790351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a34d-f7fd-45eb-bdf8-850624c4a59f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:47.790351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a34d-f7fd-45eb-bdf8-850624c4a59f None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:47.791710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:47.796654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc735-14d2-4037-83a9-e64b92ad80fa None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:47.801547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc735-14d2-4037-83a9-e64b92ad80fa None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:47.801547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc735-14d2-4037-83a9-e64b92ad80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:47.818161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-374dc735-14d2-4037-83a9-e64b92ad80fa None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:47.819587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-374dc735-14d2-4037-83a9-e64b92ad80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:47.827863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:47.982801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00a34d-f7fd-45eb-bdf8-850624c4a59f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:47.997816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00a34d-f7fd-45eb-bdf8-850624c4a59f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:48.003369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53479-4a67-4571-8f10-e8c662d996f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:48.003987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53479-4a67-4571-8f10-e8c662d996f3 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:48.004292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53479-4a67-4571-8f10-e8c662d996f3 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:48.004573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53479-4a67-4571-8f10-e8c662d996f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:48.013017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53479-4a67-4571-8f10-e8c662d996f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:48.014599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53479-4a67-4571-8f10-e8c662d996f3 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:48.024025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 761/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:51.899579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7655-6b95-449b-9a70-012095b6ea84 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:51.900169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7655-6b95-449b-9a70-012095b6ea84 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:51.900169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7655-6b95-449b-9a70-012095b6ea84 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:51.901563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:51.906861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413c35-1128-4700-99e6-7e24ebb8ac7a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:51.907285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413c35-1128-4700-99e6-7e24ebb8ac7a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:51.907427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413c35-1128-4700-99e6-7e24ebb8ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:51.927997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f2413c35-1128-4700-99e6-7e24ebb8ac7a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:51.929220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f2413c35-1128-4700-99e6-7e24ebb8ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:51.937208 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:52.011154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a7655-6b95-449b-9a70-012095b6ea84 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:52.012938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a94a7655-6b95-449b-9a70-012095b6ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:52.091827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a7655-6b95-449b-9a70-012095b6ea84 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:52.095510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855acc89-0e2a-45ba-837a-1e543e886337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:52.096831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855acc89-0e2a-45ba-837a-1e543e886337 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:52.097115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855acc89-0e2a-45ba-837a-1e543e886337 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:52.097395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855acc89-0e2a-45ba-837a-1e543e886337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:52.106644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855acc89-0e2a-45ba-837a-1e543e886337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:52.108097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855acc89-0e2a-45ba-837a-1e543e886337 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:52.117910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 768/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:54.141850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffe5be-0d83-4f16-9d96-067293d0567b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:54.142609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffe5be-0d83-4f16-9d96-067293d0567b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:54.142609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffe5be-0d83-4f16-9d96-067293d0567b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:54.144686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:51:54.150582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de001f9-857e-4793-8b63-b2701d0b6b13 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:54.151129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de001f9-857e-4793-8b63-b2701d0b6b13 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:54.151129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de001f9-857e-4793-8b63-b2701d0b6b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:54.171620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4de001f9-857e-4793-8b63-b2701d0b6b13 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:54.172896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4de001f9-857e-4793-8b63-b2701d0b6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:54.181233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:54.217828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffe5be-0d83-4f16-9d96-067293d0567b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:54.229105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffe5be-0d83-4f16-9d96-067293d0567b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:54.232641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac87444-dae4-445c-8ae8-ecebf30acba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:54.233245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87444-dae4-445c-8ae8-ecebf30acba2 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:54.233528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87444-dae4-445c-8ae8-ecebf30acba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:54.233802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87444-dae4-445c-8ae8-ecebf30acba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:54.243728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac87444-dae4-445c-8ae8-ecebf30acba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:54.245225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac87444-dae4-445c-8ae8-ecebf30acba2 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:54.257317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 764/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:57.950085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d099-145e-4c86-820e-7eab348a67a1 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:57.950736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d099-145e-4c86-820e-7eab348a67a1 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:57.950736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d099-145e-4c86-820e-7eab348a67a1 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:57.952082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:57.957897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ec883-13fa-4071-bb9c-7f7d46d06e5a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:57.958383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ec883-13fa-4071-bb9c-7f7d46d06e5a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:57.958547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ec883-13fa-4071-bb9c-7f7d46d06e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:57.966360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=81 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:57.979391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b21ec883-13fa-4071-bb9c-7f7d46d06e5a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:57.980749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b21ec883-13fa-4071-bb9c-7f7d46d06e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:57.989723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:58.310439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d099-145e-4c86-820e-7eab348a67a1 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:58.312629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b241d099-145e-4c86-820e-7eab348a67a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:58.408815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d099-145e-4c86-820e-7eab348a67a1 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:58.412743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30081c20-30bd-4a3f-8d69-ed70d5815f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:58.413375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081c20-30bd-4a3f-8d69-ed70d5815f17 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.413679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081c20-30bd-4a3f-8d69-ed70d5815f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.413953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30081c20-30bd-4a3f-8d69-ed70d5815f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.424145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30081c20-30bd-4a3f-8d69-ed70d5815f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:58.425596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30081c20-30bd-4a3f-8d69-ed70d5815f17 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:58.436090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 771/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:00.477483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bda25-2e52-4015-8f6e-d1e5b5f40da8 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:00.478061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bda25-2e52-4015-8f6e-d1e5b5f40da8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:00.478061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bda25-2e52-4015-8f6e-d1e5b5f40da8 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:00.479444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:00.484597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5526-e6d3-4a94-a59a-668abae616dd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:00.485032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5526-e6d3-4a94-a59a-668abae616dd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:00.485164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5526-e6d3-4a94-a59a-668abae616dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:00.504223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1c9c5526-e6d3-4a94-a59a-668abae616dd None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:00.505414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1c9c5526-e6d3-4a94-a59a-668abae616dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:00.513680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:00.820844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bda25-2e52-4015-8f6e-d1e5b5f40da8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:00.822522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9a2bda25-2e52-4015-8f6e-d1e5b5f40da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:00.836255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bda25-2e52-4015-8f6e-d1e5b5f40da8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:00.839740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381113c0-7cce-47a6-88a2-59fe6d4312b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:00.840396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381113c0-7cce-47a6-88a2-59fe6d4312b1 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:00.840677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381113c0-7cce-47a6-88a2-59fe6d4312b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:00.840951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381113c0-7cce-47a6-88a2-59fe6d4312b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:00.849842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381113c0-7cce-47a6-88a2-59fe6d4312b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:00.851258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381113c0-7cce-47a6-88a2-59fe6d4312b1 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:00.860743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 767/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:52:10.499517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=80 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:10.856504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=8 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:35.455153 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7757-49b7-4902-90e8-ef781d4c4c24 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.456308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7757-49b7-4902-90e8-ef781d4c4c24 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.456308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7757-49b7-4902-90e8-ef781d4c4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.481494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d39f7757-49b7-4902-90e8-ef781d4c4c24 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.482692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f794fa1-5cc5-43fb-bb6c-34c974f8bb15 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.483212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d39f7757-49b7-4902-90e8-ef781d4c4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.483891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f794fa1-5cc5-43fb-bb6c-34c974f8bb15 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.483891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f794fa1-5cc5-43fb-bb6c-34c974f8bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.496182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 773/1540] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.515467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0f794fa1-5cc5-43fb-bb6c-34c974f8bb15 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.516965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0f794fa1-5cc5-43fb-bb6c-34c974f8bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.517868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d35f-8fb2-4511-83df-8aedbe777601 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.518164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d35f-8fb2-4511-83df-8aedbe777601 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.518448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d35f-8fb2-4511-83df-8aedbe777601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.540766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 768/1541] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:35.543223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded53b-faed-4f85-9e15-c5f22ec2aee7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.543787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded53b-faed-4f85-9e15-c5f22ec2aee7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.544297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded53b-faed-4f85-9e15-c5f22ec2aee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.553147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4fb2d35f-8fb2-4511-83df-8aedbe777601 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.555234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4fb2d35f-8fb2-4511-83df-8aedbe777601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.568439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 774/1542] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:35.569716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ce57b-f65f-4119-ae2a-c2b3b38e05df None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.570009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ce57b-f65f-4119-ae2a-c2b3b38e05df None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.570289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ce57b-f65f-4119-ae2a-c2b3b38e05df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.576745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-99ded53b-faed-4f85-9e15-c5f22ec2aee7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.578201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-99ded53b-faed-4f85-9e15-c5f22ec2aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.591792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 769/1543] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.593666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e49e0-5306-4359-ae46-41212f93587b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.594079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e49e0-5306-4359-ae46-41212f93587b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.594363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e49e0-5306-4359-ae46-41212f93587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.599606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e62ce57b-f65f-4119-ae2a-c2b3b38e05df None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.600882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e62ce57b-f65f-4119-ae2a-c2b3b38e05df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.610045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 775/1544] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.611300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb03c6-ebcd-4f56-8e23-6ef04970b010 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.611589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb03c6-ebcd-4f56-8e23-6ef04970b010 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.611966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb03c6-ebcd-4f56-8e23-6ef04970b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.616278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-783e49e0-5306-4359-ae46-41212f93587b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.617509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-783e49e0-5306-4359-ae46-41212f93587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.627177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 770/1545] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.627957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e49e0-5306-4359-ae46-41212f93587b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.633069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-58cb03c6-ebcd-4f56-8e23-6ef04970b010 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.634462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-58cb03c6-ebcd-4f56-8e23-6ef04970b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.638335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e49e0-5306-4359-ae46-41212f93587b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.642830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 776/1546] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.643656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.644096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edafb8-6009-4c2c-b7db-029eb8b8bb3a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.644318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.644596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edafb8-6009-4c2c-b7db-029eb8b8bb3a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.644717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.644890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.645010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edafb8-6009-4c2c-b7db-029eb8b8bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.645597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:35.645910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.646936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:53:35.646936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:53:35.646936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:53:35.647847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebdde9-b3ba-4f0b-b8d5-c2ef0cae33a8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:35.662111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 771/1547] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:35.663360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.663657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.663972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.664518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-11edafb8-6009-4c2c-b7db-029eb8b8bb3a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.665742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-11edafb8-6009-4c2c-b7db-029eb8b8bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.674672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 777/1548] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.675988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292cd5-0c27-4bc1-a50c-be7b4ec48e94 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.676285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292cd5-0c27-4bc1-a50c-be7b4ec48e94 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.676563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df292cd5-0c27-4bc1-a50c-be7b4ec48e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.684754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.685983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.694407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 772/1549] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.695287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.696108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-df292cd5-0c27-4bc1-a50c-be7b4ec48e94 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.697310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-df292cd5-0c27-4bc1-a50c-be7b4ec48e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.705359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300f3f-84c6-48e0-bd7d-1ffc997350d4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.705792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 778/1550] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.707095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13972daf-076b-4836-9ffe-bfd56b5a5fcd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.707390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13972daf-076b-4836-9ffe-bfd56b5a5fcd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.707664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13972daf-076b-4836-9ffe-bfd56b5a5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.710444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.711067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.711331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.711600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.712323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:35.712624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.714240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389ac9c-d04a-480d-86cf-a5a9698a20da admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:35.727802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 773/1551] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:35.728616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-13972daf-076b-4836-9ffe-bfd56b5a5fcd None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.729629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.730054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.730231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-13972daf-076b-4836-9ffe-bfd56b5a5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.730373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.739309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 779/1552] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.740770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ec61-2bc6-424e-bc0d-2af639f80962 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.741189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ec61-2bc6-424e-bc0d-2af639f80962 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.741577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ec61-2bc6-424e-bc0d-2af639f80962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.752518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.753747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.761658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c8e0ec61-2bc6-424e-bc0d-2af639f80962 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.762047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 774/1553] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.762817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.763245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c8e0ec61-2bc6-424e-bc0d-2af639f80962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.772151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 780/1554] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.773147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f435b6-0d54-4ba1-8fa5-e32145978131 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.773453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddfb63-9332-4726-a1e2-16cea454f192 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.773733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddfb63-9332-4726-a1e2-16cea454f192 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.774033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddfb63-9332-4726-a1e2-16cea454f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.779874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53068d2-10a6-4263-ae25-e6ec1fd343ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.781281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53068d2-10a6-4263-ae25-e6ec1fd343ac admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.781573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53068d2-10a6-4263-ae25-e6ec1fd343ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.781855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53068d2-10a6-4263-ae25-e6ec1fd343ac admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.782590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53068d2-10a6-4263-ae25-e6ec1fd343ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.784594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53068d2-10a6-4263-ae25-e6ec1fd343ac admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:35.794487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-28ddfb63-9332-4726-a1e2-16cea454f192 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.795700 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-28ddfb63-9332-4726-a1e2-16cea454f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.804621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 781/1555] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.805768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.806057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.806337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.826224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.827466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.835360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 782/1556] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.836170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.846986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62530ff-8781-4cf5-92de-26d12c131e4f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.851787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.852392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.852675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.852951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.853643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:35.853945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.855534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:35.868870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 783/1557] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:35.869904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.879883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927b03-66ab-4c82-b8d8-9a11a0367bfd admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.885038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.885655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.885943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.886222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.886892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.888180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:53:35.888180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:53:35.888180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:53:35.888448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 775/1558] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:35.889351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:35.889591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.889943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.890285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.910574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.915082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.973489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 776/1559] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.974379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.983767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734e699-f6b1-45a5-9ed5-6489ef01b3b7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.988745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.989340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.989626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.989909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.990606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:35.990915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.992595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.001458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 784/1560] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.002530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.004819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 777/1561] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:36.005637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.020598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d509f-f01a-48f6-b611-35878047ef67 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.072610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d9508-c3a9-4fa0-ba14-dc122b3b6104 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.073153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:36.078547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.079179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.079484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.079743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.080143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.080480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:36.080793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.080909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.081097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.081374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.082105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:36.082395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.082501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.084065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.095083 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 785/1562] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:36.096079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.104828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 778/1563] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:36.105744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.105953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5079-8643-4934-84de-bc474ab30a59 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.113052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.113793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.114086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.114370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.115076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:36.115388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.117384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.119961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edc011-f43b-457b-ac2a-dc2ddd38e2c6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.124995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.125617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.125898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.126173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.126828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.128894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.138863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 786/1564] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:36.138863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.144967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcedfc-3093-4e23-ae0d-e3865750c273 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.149869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.150476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.150754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.151031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.151696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.153622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.277637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 779/1565] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.278488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.317772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 787/1566] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.318840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.331091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326906b6-a185-4ffc-8291-7a13fcebdef0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.349144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443659-5b72-49d5-94b2-d829e4787c24 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.352096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:36.354213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.354859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.355140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.355412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.356140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:36.356444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.358027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.370456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 780/1567] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:36.371055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.383038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cebe6-8024-45e2-b340-1ac6f654b6ef admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.387977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.388582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.388888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.389164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.390447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.391163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.391938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.392228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.392380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.392510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.393187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.395140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.510562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 788/1568] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.511466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.521999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bc83a-c371-460b-916b-3049cd3c7bee admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.527220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.527856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.528152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.528433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.529101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.531003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.537011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 781/1569] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.537011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.600064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce70340-602e-47b2-a4a0-ca8cceb6872d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.604639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.605236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.605550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.605867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.606508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.608444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.652069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 789/1570] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.653019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.719266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c382e-f78b-4490-b0ec-84acbde70723 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.724212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.724839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.725122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.725407 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.726128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.728175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.739504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 782/1571] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.740445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.771775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:36.804639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea62d46-6362-40b6-b0fb-c29ad1738eba admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.809330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.810026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.810312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.810590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.811271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.812970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:53:36.812970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:53:36.812970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:53:36.814277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.832009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 790/1572] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.841170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.895428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f845d4-28c7-4d24-ac25-37fbd2e980d0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.900007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.900623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.900908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.901184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.901880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.903466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.913845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 791/1573] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:36.914833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.925174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0cded-5959-43ce-bd21-8c83b6f59060 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.930953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 783/1574] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:36.930953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.932739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.933392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.933683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.933973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.934646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.936622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.940267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607d24-7fb1-490e-8292-0d86b7282fba admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.945746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.946496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.946789 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.947070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.947832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.948229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:36.949438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:36.960316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 784/1575] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:36.961142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:36.971114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001679b-e373-4fbe-a364-5bd0cd69c59d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:36.976112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:36.976697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:36.976979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:36.977253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:36.977898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:36.979792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.063967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 792/1576] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:37.063967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.096403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 785/1577] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:36 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:37.096403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.108982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b19e5-e75c-4414-b8f4-d1596b51eb95 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.142365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0ca70-a951-4241-954b-0440e20656e8 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.148591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.149186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.149469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.149743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.150414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.152427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.174479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.175586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.175586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.175855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.176568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.178540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.237281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 793/1578] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:37 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:37.237914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.247948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ec14-9d13-4fc7-8e65-8e6991946d8b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.253014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.253591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.253881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.254163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.254833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.257104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.275349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 786/1579] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:37 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:37.275349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.289746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53630e4-9d87-4a4e-a798-e0e3e4fb2299 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.294983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.295630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.296000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.296277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.296982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.300047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.310976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 787/1580] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.311824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.321344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668396-ca47-48ff-824f-af3def99c944 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.326069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.326660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.326946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.327225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.327953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.329616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.340224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 788/1581] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.341006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.351310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3f4e-2a70-4804-a31d-7edddfe25546 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.355926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.356497 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.356782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.357060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.357725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.359260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.369790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 789/1582] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.370540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.380494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f8ac-8de2-4460-86bb-b28794ded1ba admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.385418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.385999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.386285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.386558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.387206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.389199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.408150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 794/1583] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:37 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:37.408150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.412953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b04c48-6a86-44ef-8c7e-8da09cb8d3cf admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.417633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.418247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.418530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.418825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.419538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.421181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.432681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 795/1584] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.433656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.443901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720f20-6239-4578-af0e-915e7d3a3949 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.448458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.449040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.449332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.449621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.450373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.451996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.462043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 796/1585] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.462970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.472462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677461a0-5042-4c7a-8b04-c760e3087ae4 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.476946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.477514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.477801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.478086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.478746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.480315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.490405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 797/1586] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.491323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.499191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 790/1587] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:37 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:37.500296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.501557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55e7e-9361-410c-963f-9e75df074085 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.506904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.507561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.507883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.508178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] PATH_INFO: `/v3/projects/579f99a04f874ff09c2d2b91ac6742d9/users/e4ede7edc4914685ba57b26711d08fe0/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.511527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba70f4-e9e8-418b-b69c-79eab361a95a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.516494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.517257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.517536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.517815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.518559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.520302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.523637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579f99a04f874ff09c2d2b91ac6742d9, user_id=e4ede7edc4914685ba57b26711d08fe0, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.524790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:53:37.524790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:53:37.524790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:53:37.526778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.531281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 791/1588] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.536656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.542131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ec66-c16d-4ba6-b0f7-b709674a6e2d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.546868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.548229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.548518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.548797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] PATH_INFO: `/v3/projects/11381c13ef7b4e0088fc9271c688d6d9/users/cc5910761e914b339984f443364f5272/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.560587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:37.564412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11381c13ef7b4e0088fc9271c688d6d9, user_id=cc5910761e914b339984f443364f5272, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.567065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.635919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 798/1589] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:37 2022] PUT /identity/v3/projects/579f99a04f874ff09c2d2b91ac6742d9/users/e4ede7edc4914685ba57b26711d08fe0/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:37.636855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.664625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 792/1590] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:37 2022] PUT /identity/v3/projects/11381c13ef7b4e0088fc9271c688d6d9/users/cc5910761e914b339984f443364f5272/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:37.665449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.711172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0e803-d221-4237-858c-41bcd0dfd018 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.719364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:37.740755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfee404-dc71-460b-b9f8-55f0069988b6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.740755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.740755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.740755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.741214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.741214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.741214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.749325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 793/1591] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.750222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.761330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204f006-28f2-44d0-b6f2-b7d9347b8fdf admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.767517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.768178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.768460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.768757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.769435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.770890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.771031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.771564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.771878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.772158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.772927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.774536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.781366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 794/1592] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.782923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.785862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 799/1593] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.787125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.793135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a0590-dc14-47f3-88d5-814f689aaa8d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.798221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3f73-91a8-46b5-9414-fccb688a81bc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.798584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.799201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.799488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.799863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.800545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.802183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.803279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f607a4-6b7b-4e58-ba9b-7232e1e4960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.803944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f607a4-6b7b-4e58-ba9b-7232e1e4960a admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.804234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f607a4-6b7b-4e58-ba9b-7232e1e4960a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.804520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f607a4-6b7b-4e58-ba9b-7232e1e4960a admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.805220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f607a4-6b7b-4e58-ba9b-7232e1e4960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.806846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f607a4-6b7b-4e58-ba9b-7232e1e4960a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.813795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 795/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.814628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.825656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 800/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:37.825656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306880-3fcb-4253-b4af-6482ce5e0d12 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.825656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306880-3fcb-4253-b4af-6482ce5e0d12 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.825656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306880-3fcb-4253-b4af-6482ce5e0d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.826138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca777c5-68d3-4c30-a59e-3b7298ce29c3 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:37.830403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:37.831091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.831381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.831666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] PATH_INFO: `/v3/projects/c0bfa9bdb34f4c4382096c0a0330353c/users/0940cde66b1247b89a34b60a3dbe3452/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.847247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bfa9bdb34f4c4382096c0a0330353c, user_id=0940cde66b1247b89a34b60a3dbe3452, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:37.850035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:37.853882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-20306880-3fcb-4253-b4af-6482ce5e0d12 None None] MFA Rules not processed for user `e4ede7edc4914685ba57b26711d08fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:37.855121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-20306880-3fcb-4253-b4af-6482ce5e0d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:37.921559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 801/1596] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:37.922978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:37.923434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:37.923717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:37.939115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 796/1597] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:37 2022] PUT /identity/v3/projects/c0bfa9bdb34f4c4382096c0a0330353c/users/0940cde66b1247b89a34b60a3dbe3452/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:37.939115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:37.959632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] MFA Rules not processed for user `cc5910761e914b339984f443364f5272`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:37.961364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.020044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4b0dd-aa37-4364-944d-c4ab76bef024 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.027230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.030960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.030960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.030960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] PATH_INFO: `/v3/projects/c68d42e80b964062ba17323e39890a70/users/41edb7b542a042b8a628bfb9c3d4795d/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.039340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 802/1598] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.040416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.049325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68d42e80b964062ba17323e39890a70, user_id=41edb7b542a042b8a628bfb9c3d4795d, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.051741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca7fa0-3ed4-43ef-b555-b942c5b5db98 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.053674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.056561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.057242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.057527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.057806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] PATH_INFO: `/v3/projects/ba8f475902014cb383f6f8d387ffdb79/users/9e9955f5ee3c4ff7884b2492ea16d3c0/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.070932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:38.073951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8f475902014cb383f6f8d387ffdb79, user_id=9e9955f5ee3c4ff7884b2492ea16d3c0, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.076645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.133508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 797/1599] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:37 2022] PUT /identity/v3/projects/c68d42e80b964062ba17323e39890a70/users/41edb7b542a042b8a628bfb9c3d4795d/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:38.134422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.161374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:38.196421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f332e7-c15d-4053-969c-f13f10966637 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.200054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 803/1600] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:38 2022] PUT /identity/v3/projects/ba8f475902014cb383f6f8d387ffdb79/users/9e9955f5ee3c4ff7884b2492ea16d3c0/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:38.200857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.257688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.258322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.258613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.258891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.259598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.261296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.266782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411bebe-f75e-4caf-b006-749c229a5b92 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.270686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff6aed-9741-4147-b51e-27c4edd141a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.271360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6aed-9741-4147-b51e-27c4edd141a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.271652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6aed-9741-4147-b51e-27c4edd141a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.271949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 798/1601] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:38.272548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.275036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6aed-9741-4147-b51e-27c4edd141a5 admin admin] PATH_INFO: `/v3/projects/c11aa37b98d34373a1fbca69d97d1374/users/7c4dee65a8054f028fae113d5c31406e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.283726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33cef-4471-43a9-8781-79dafa6fe81d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.291286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff6aed-9741-4147-b51e-27c4edd141a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11aa37b98d34373a1fbca69d97d1374, user_id=7c4dee65a8054f028fae113d5c31406e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.293375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37007967-6680-4498-88ec-00ea8755389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.293975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff6aed-9741-4147-b51e-27c4edd141a5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.294102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007967-6680-4498-88ec-00ea8755389f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.294281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007967-6680-4498-88ec-00ea8755389f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.294560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007967-6680-4498-88ec-00ea8755389f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.299460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37007967-6680-4498-88ec-00ea8755389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.299460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37007967-6680-4498-88ec-00ea8755389f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.311707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 799/1602] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:38.311707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4ad4-5b11-42f3-9dd0-f9bbd5fe1209 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.311707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4ad4-5b11-42f3-9dd0-f9bbd5fe1209 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.311707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4ad4-5b11-42f3-9dd0-f9bbd5fe1209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.330239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3e6d4ad4-5b11-42f3-9dd0-f9bbd5fe1209 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.331509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3e6d4ad4-5b11-42f3-9dd0-f9bbd5fe1209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.339634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 800/1603] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.340913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080730c-86a1-4481-94b6-b04011a64c6e None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.341204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080730c-86a1-4481-94b6-b04011a64c6e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.341483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080730c-86a1-4481-94b6-b04011a64c6e None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.343004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 801/1604] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jul 25 22:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:38.343842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080730c-86a1-4481-94b6-b04011a64c6e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.390662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 804/1605] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:38 2022] PUT /identity/v3/projects/c11aa37b98d34373a1fbca69d97d1374/users/7c4dee65a8054f028fae113d5c31406e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:38.392183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156e76-1e94-434e-8a2d-a39c26727590 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.392555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156e76-1e94-434e-8a2d-a39c26727590 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.392941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156e76-1e94-434e-8a2d-a39c26727590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.405003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080730c-86a1-4481-94b6-b04011a64c6e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.421348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-85156e76-1e94-434e-8a2d-a39c26727590 None None] MFA Rules not processed for user `41edb7b542a042b8a628bfb9c3d4795d`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.423277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-85156e76-1e94-434e-8a2d-a39c26727590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.454545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.455083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.455374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.455653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.474676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:38.489080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 805/1606] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.490513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.490695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.490972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.510928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.512219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.518896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.520444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.529525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 802/1607] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:38.530299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.578339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 806/1608] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.579187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.586615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:38.590585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1492c-7fef-402e-85a7-99436eedb1bb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.596103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a93950-245b-4db7-8b80-b36157475fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.596932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93950-245b-4db7-8b80-b36157475fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.597313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93950-245b-4db7-8b80-b36157475fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.597669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93950-245b-4db7-8b80-b36157475fbc admin admin] PATH_INFO: `/v3/projects/ec54531184694ef4a4201c006901c2d8/users/7f54b07b4dbc4e67b44a1c3ff6d60226/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.610161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84933971-34d4-4435-b271-e1a30886d9c8 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.614827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a93950-245b-4db7-8b80-b36157475fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec54531184694ef4a4201c006901c2d8, user_id=7f54b07b4dbc4e67b44a1c3ff6d60226, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.616402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.617119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.617547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.617836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] PATH_INFO: `/v3/projects/e7b9d6c248714ebc850bd652ea2cf321/users/ce97f14d85034cd09014b9d5987fdc45/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.618039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a93950-245b-4db7-8b80-b36157475fbc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.635544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b9d6c248714ebc850bd652ea2cf321, user_id=ce97f14d85034cd09014b9d5987fdc45, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.638288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.699512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 807/1609] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:38 2022] PUT /identity/v3/projects/ec54531184694ef4a4201c006901c2d8/users/7f54b07b4dbc4e67b44a1c3ff6d60226/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:38.700905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015ea1-5dad-4b0d-8f4a-6187eaee3104 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.703210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015ea1-5dad-4b0d-8f4a-6187eaee3104 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.703210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015ea1-5dad-4b0d-8f4a-6187eaee3104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.734194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 803/1610] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:38 2022] PUT /identity/v3/projects/e7b9d6c248714ebc850bd652ea2cf321/users/ce97f14d85034cd09014b9d5987fdc45/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:38.735721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.746146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-18015ea1-5dad-4b0d-8f4a-6187eaee3104 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.747541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-18015ea1-5dad-4b0d-8f4a-6187eaee3104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.808174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594398b-7d45-4e38-bdb4-d8dd485f58d9 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.812227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.812858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.813231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.813725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.822784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 808/1611] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.824252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.824587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.824886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.843398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.845301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.877955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:38.882139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.883728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.893689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 804/1612] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:38.894660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.907788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8165-8372-4b8c-9ce8-72b6ef2018c1 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.913811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 809/1613] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.914170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.914378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.914808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.915091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.915368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.915838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.916080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.917989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.931147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263aaa-d4dd-491b-ba6d-95ff42fadf88 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.935624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e888f7c-626c-4efb-aeb5-a1f3c9a3bf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.937400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e888f7c-626c-4efb-aeb5-a1f3c9a3bf42 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.937400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e888f7c-626c-4efb-aeb5-a1f3c9a3bf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.937400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e888f7c-626c-4efb-aeb5-a1f3c9a3bf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.946725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e888f7c-626c-4efb-aeb5-a1f3c9a3bf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.948309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e888f7c-626c-4efb-aeb5-a1f3c9a3bf42 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.958833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 810/1614] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:38.960148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403c7c-f03b-49ec-a574-d2bea3015bb9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.960439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403c7c-f03b-49ec-a574-d2bea3015bb9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.960717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403c7c-f03b-49ec-a574-d2bea3015bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.980214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9c403c7c-f03b-49ec-a574-d2bea3015bb9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.981427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9c403c7c-f03b-49ec-a574-d2bea3015bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.989351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 811/1615] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.990606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.990894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.991165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.019123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] MFA Rules not processed for user `ce97f14d85034cd09014b9d5987fdc45`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:39.020365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:39.056324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:39.068245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 805/1616] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:39.069257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.117166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 812/1617] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:39.118986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.133576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958f7b8-92b3-4316-a038-0e149a5e3881 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.199619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cdf95-9f35-49d8-8637-515ff96645bb admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.202622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.203495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.203495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.203864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.207923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.208666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.209044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.209533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.275151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.277081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.302037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 813/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:39.302724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.302916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.304477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.320702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a873-8ec8-4527-ac94-49036e80f211 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.325108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb43b2-0673-4211-828a-51dcaa16c1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.325865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb43b2-0673-4211-828a-51dcaa16c1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.326157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb43b2-0673-4211-828a-51dcaa16c1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.326524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb43b2-0673-4211-828a-51dcaa16c1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.329537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 806/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:39.330488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.339369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb43b2-0673-4211-828a-51dcaa16c1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.341108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb43b2-0673-4211-828a-51dcaa16c1d2 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.346788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77e1d-2949-490a-9197-cfccf87f86c2 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.355640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.356314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.356598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.356868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.358296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 814/1620] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:39.359748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.361227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cba91a-41ea-485d-86ad-a441e884f3af None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.362718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cba91a-41ea-485d-86ad-a441e884f3af None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.363010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cba91a-41ea-485d-86ad-a441e884f3af None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.364128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.366155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 815/1621] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jul 25 22:53:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:39.371644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.371872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.372159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.400762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:39.402129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:39.421680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 816/1622] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jul 25 22:53:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:39.430861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.444238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc82a6-68eb-4d5f-a5d5-c9ec915abfa7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.451513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2e8ad-a82b-4cf9-9bb2-9a48a5ee908b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.452266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e8ad-a82b-4cf9-9bb2-9a48a5ee908b service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.452466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e8ad-a82b-4cf9-9bb2-9a48a5ee908b service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.452742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e8ad-a82b-4cf9-9bb2-9a48a5ee908b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.478522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 807/1623] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:39 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:39.480486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.503925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cbc88-31be-4943-bcfa-416fc88bb6ec admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.519966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.524006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.524006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.524006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.525110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.527793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.543090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 808/1624] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:39.544251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.556842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7586-a1f5-4032-bb87-40679caf144c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.559285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2e8ad-a82b-4cf9-9bb2-9a48a5ee908b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.561064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2e8ad-a82b-4cf9-9bb2-9a48a5ee908b service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.562409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.563830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.564219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.564593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] PATH_INFO: `/v3/projects/bbfac8e2e2a24e608559642c097ec45b/users/17ca03a0b4b946889e7bc6e0db72c0ec/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.565825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:39.572494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 817/1625] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:39.605328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfac8e2e2a24e608559642c097ec45b, user_id=17ca03a0b4b946889e7bc6e0db72c0ec, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.611172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.633168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1c23d-e325-47e4-adb3-6cc0ee606c87 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.633611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1c23d-e325-47e4-adb3-6cc0ee606c87 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.633766 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1c23d-e325-47e4-adb3-6cc0ee606c87 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.635288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 818/1626] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 25 22:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:53:39.641097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.641619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.641968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.676311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:39.679031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:39.693197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 819/1627] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:53:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:39.711069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.760303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 809/1628] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:39 2022] PUT /identity/v3/projects/bbfac8e2e2a24e608559642c097ec45b/users/17ca03a0b4b946889e7bc6e0db72c0ec/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:39.765817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.801525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:39.815637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8d0d2-552c-492b-8834-1fd8fcfda72b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.869552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43b9d6-d756-4b39-be08-2dba3101719e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.870242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b9d6-d756-4b39-be08-2dba3101719e service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.870527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b9d6-d756-4b39-be08-2dba3101719e service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.870805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b9d6-d756-4b39-be08-2dba3101719e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.884007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45e94f-00c9-4d9a-ad05-cfc021b41e91 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.891459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.892617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.893045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.893671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.895119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.897531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:39.916842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 810/1629] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:39.932930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:39.959243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25894ee-8f34-4ed7-a294-c71af956986b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:39.971900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0917566-a99d-4b3c-a88d-e5b4bf21a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:39.974198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0917566-a99d-4b3c-a88d-e5b4bf21a598 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:39.974918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0917566-a99d-4b3c-a88d-e5b4bf21a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:39.976894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0917566-a99d-4b3c-a88d-e5b4bf21a598 admin admin] PATH_INFO: `/v3/projects/bbfac8e2e2a24e608559642c097ec45b/users/17ca03a0b4b946889e7bc6e0db72c0ec/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:39.982165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0917566-a99d-4b3c-a88d-e5b4bf21a598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfac8e2e2a24e608559642c097ec45b, user_id=17ca03a0b4b946889e7bc6e0db72c0ec, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:39.991094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0917566-a99d-4b3c-a88d-e5b4bf21a598 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:40.029309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43b9d6-d756-4b39-be08-2dba3101719e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:40.031290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 811/1630] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:39 2022] PUT /identity/v3/projects/bbfac8e2e2a24e608559642c097ec45b/users/17ca03a0b4b946889e7bc6e0db72c0ec/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:40.040827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43b9d6-d756-4b39-be08-2dba3101719e service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:40.042587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.042892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.043228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.058363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 820/1631] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:53:40.114233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] MFA Rules not processed for user `17ca03a0b4b946889e7bc6e0db72c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:40.116276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:40.222875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa42c3-5b82-4465-aca9-9e9a4ae48ff7 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.223606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa42c3-5b82-4465-aca9-9e9a4ae48ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.223606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa42c3-5b82-4465-aca9-9e9a4ae48ff7 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.226103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 821/1632] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 25 22:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:40.236348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.236779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.237088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.282452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:40.287375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:40.289085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 812/1633] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:40.309488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:40.362671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:40.405390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 822/1634] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:53:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:40.437768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775d5b4-ffbf-4ad8-a49c-12960f8146c7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:40.442764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:40.443851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.443851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.458659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.458659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:40.458659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:40.469082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 813/1635] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:53:40.612383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:40.621656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6f80-e830-406a-86f0-895caa179882 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:40.625404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:40.626635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.626925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.627656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.639060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:40.640425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:40.654491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 823/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:41.270110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:41.270110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad8ddd-d008-4d3a-b960-eedd424d2b92 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:41.270110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1730c-ca84-4153-a2b1-c4bd0c310b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:41.270110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1730c-ca84-4153-a2b1-c4bd0c310b8d service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:41.277347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1730c-ca84-4153-a2b1-c4bd0c310b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:41.277347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1730c-ca84-4153-a2b1-c4bd0c310b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:41.277347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:41.277347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1730c-ca84-4153-a2b1-c4bd0c310b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:41.277347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1730c-ca84-4153-a2b1-c4bd0c310b8d service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:41.277347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 814/1637] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:41.279296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:41.352954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30aee-713b-4617-a75b-d93508f3fae3 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:41.360515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:41.361706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:41.362181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:41.362473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] PATH_INFO: `/v3/users/ce97f14d85034cd09014b9d5987fdc45` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:41.363782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce97f14d85034cd09014b9d5987fdc45)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:41.364958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: WARNING py.warnings [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:53:41.364958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: warnings.warn(msg) Jul 25 22:53:41.364958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: Jul 25 22:53:41.366048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:41.676209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce97f14d85034cd09014b9d5987fdc45'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:41.677240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce97f14d85034cd09014b9d5987fdc45'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:41.691795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce97f14d85034cd09014b9d5987fdc45'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:41.692764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce97f14d85034cd09014b9d5987fdc45'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:41.717041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce97f14d85034cd09014b9d5987fdc45'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:41.841145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:41.841646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:41.842069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:41.842268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 824/1638] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:41 2022] DELETE /identity/v3/users/ce97f14d85034cd09014b9d5987fdc45 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:41.872788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:41.874259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:42.007778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 815/1639] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:42.014348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:42.017742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:42.123462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:42.135044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926a113-954e-4ab3-ae0e-ddb5bd91f454 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:42.143231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4af3-f560-453b-bfdd-34e751e17a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:42.143975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4af3-f560-453b-bfdd-34e751e17a4a service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:42.144324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4af3-f560-453b-bfdd-34e751e17a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:42.144612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4af3-f560-453b-bfdd-34e751e17a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:42.155174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4af3-f560-453b-bfdd-34e751e17a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:42.156733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4af3-f560-453b-bfdd-34e751e17a4a service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:42.170306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 825/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:43.603175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:43.606417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:43.638155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8e31-6941-4e76-92fc-ba058cf8bb52 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:43.651336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:43.653340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:43.654666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:43.655560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] PATH_INFO: `/v3/projects/e7b9d6c248714ebc850bd652ea2cf321` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:43.660524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b9d6c248714ebc850bd652ea2cf321)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:43.661721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: WARNING py.warnings [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:53:43.661721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: warnings.warn(msg) Jul 25 22:53:43.661721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: Jul 25 22:53:43.663231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:43.957069 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b9d6c248714ebc850bd652ea2cf321', 'request_id': 'req-1d596c78-3348-47b6-947a-f6e8c049eb76'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:44.043242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b9d6c248714ebc850bd652ea2cf321', 'request_id': 'req-1d596c78-3348-47b6-947a-f6e8c049eb76'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:44.067395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b9d6c248714ebc850bd652ea2cf321', 'request_id': 'req-1d596c78-3348-47b6-947a-f6e8c049eb76'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:44.103962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] The token cache is being invalidate because project e7b9d6c248714ebc850bd652ea2cf321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:44.104573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:44.107370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1d596c78-3348-47b6-947a-f6e8c049eb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:44.112118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 816/1641] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:43 2022] DELETE /identity/v3/projects/e7b9d6c248714ebc850bd652ea2cf321 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:44.121874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6af28-9728-482d-a755-752a13275423 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:44.125005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6af28-9728-482d-a755-752a13275423 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:44.126462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6af28-9728-482d-a755-752a13275423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:44.159339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a1a6af28-9728-482d-a755-752a13275423 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:44.160904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a1a6af28-9728-482d-a755-752a13275423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:44.278505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 826/1642] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:44.287788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:44.288097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:44.288367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:44.356883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:44.358314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:44.380584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6af28-9728-482d-a755-752a13275423 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:44.387881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 817/1643] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:44.404239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6af28-9728-482d-a755-752a13275423 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:44.418983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:44.419799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:44.420088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:44.420366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:44.423408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:44.423740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:44.429033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:44.457903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 827/1644] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:44.461967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:44.477778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464735df-a90d-45e8-9e53-f465bf8968b4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:44.484362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:44.488293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:44.488293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:44.488293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:44.488293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:44.489688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:44.626931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 818/1645] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:44 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:44.631554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:44.648577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f85433-7b24-4023-bbe4-bf30629e6051 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:44.789984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:44.790219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:44.790492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:44.790768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:44.791452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:44.805644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:44.978327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 828/1646] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:44 2022] POST /identity/v3/users => generated 294 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:44.979286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:44.995711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02684d80-3a49-4efc-8a03-0d3400b1d8ca admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:45.004916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:45.005965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.006715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.007199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.008244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:45.011631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:45.036768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 819/1647] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:45.040946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:45.054958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8fd5-ba72-45df-ad52-7c290f37b3c3 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:45.062386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c4c0d-fd4c-415f-b294-bce9160c2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:45.076961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c4c0d-fd4c-415f-b294-bce9160c2402 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.076961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c4c0d-fd4c-415f-b294-bce9160c2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.076961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c4c0d-fd4c-415f-b294-bce9160c2402 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.076961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c4c0d-fd4c-415f-b294-bce9160c2402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:45.076961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c4c0d-fd4c-415f-b294-bce9160c2402 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:45.092763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 829/1648] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:45.096226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:45.159100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0602d46-6458-41fc-9542-88c69d4e5bb4 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:45.174322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:45.175881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.176178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.176463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] PATH_INFO: `/v3/projects/0b21f7b11e7b4637998997ab49ec4f00/users/be9e848d653f4ee78c01891ef8e8519e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.182515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:45.214135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b21f7b11e7b4637998997ab49ec4f00, user_id=be9e848d653f4ee78c01891ef8e8519e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:45.222562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:45.410266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 820/1649] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:45 2022] PUT /identity/v3/projects/0b21f7b11e7b4637998997ab49ec4f00/users/be9e848d653f4ee78c01891ef8e8519e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:53:45.412400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.412864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.412958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.512491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] MFA Rules not processed for user `be9e848d653f4ee78c01891ef8e8519e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:45.516999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:45.629674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:45.679075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 830/1650] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:45.683355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:45.877920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2843d9-16ef-40d7-adaf-8e93d4cbcc7d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:45.901573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:45.912918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.913146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.914233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.915122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:45.919522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:46.087094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 821/1651] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:45 2022] POST /identity/v3/projects => generated 385 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:46.088186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:46.116519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c85b4-16e6-49ea-addf-5b6663c6d755 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:46.253805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:46.254484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:46.254778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:46.255063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:46.255831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:46.258064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:46.401737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 831/1652] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:46 2022] POST /identity/v3/users => generated 299 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:46.405931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:46.425519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0104-d2f5-44ae-a6af-996d72046a90 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:46.442691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:46.443354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:46.443643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:46.443953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:46.444676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:46.446677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:46.498125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:46.498598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 822/1653] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:46.509526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b3745-bf9c-4884-a327-306c363845a8 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:46.530245 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:46.531166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:46.531725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:46.532914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] PATH_INFO: `/v3/projects/cd3e9298c5ff4cedaf3a8d1110b1bde5/users/0b4cf13d786c440cba77c535a0f00878/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:46.585891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3e9298c5ff4cedaf3a8d1110b1bde5, user_id=0b4cf13d786c440cba77c535a0f00878, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:46.587313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:46.688158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:46.688613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 832/1654] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:46 2022] PUT /identity/v3/projects/cd3e9298c5ff4cedaf3a8d1110b1bde5/users/0b4cf13d786c440cba77c535a0f00878/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:46.709249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4312b-c8b4-446f-80f5-8c50f2f5b050 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:46.816719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:46.818586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:46.886904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:46.887793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:46.888220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:46.888636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:46.889530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:46.892297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:46.920586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 823/1655] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:46.921538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:46.941078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c490cce-f3bb-40da-ae76-a7a0e17f1997 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:46.967568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81d3d6-bf6b-4f7a-9b9a-b62999c46c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:46.968539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81d3d6-bf6b-4f7a-9b9a-b62999c46c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:46.968966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81d3d6-bf6b-4f7a-9b9a-b62999c46c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:46.970276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81d3d6-bf6b-4f7a-9b9a-b62999c46c2e admin admin] PATH_INFO: `/v3/projects/cd3e9298c5ff4cedaf3a8d1110b1bde5/users/0b4cf13d786c440cba77c535a0f00878/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:46.976335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81d3d6-bf6b-4f7a-9b9a-b62999c46c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3e9298c5ff4cedaf3a8d1110b1bde5, user_id=0b4cf13d786c440cba77c535a0f00878, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:46.979359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81d3d6-bf6b-4f7a-9b9a-b62999c46c2e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:47.005409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 824/1656] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:46 2022] PUT /identity/v3/projects/cd3e9298c5ff4cedaf3a8d1110b1bde5/users/0b4cf13d786c440cba77c535a0f00878/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:47.017040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.017333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.017614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.083264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] MFA Rules not processed for user `0b4cf13d786c440cba77c535a0f00878`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:47.084558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:47.090641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6b70-ece1-4583-a69c-56703d2c548b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:47.260256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 825/1657] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:47.274058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:47.276557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:47.277662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:47.284511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:47.284511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.284511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.284849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] PATH_INFO: `/v3/users/41edb7b542a042b8a628bfb9c3d4795d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.287139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41edb7b542a042b8a628bfb9c3d4795d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:47.292021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:47.421733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8a126-ecc0-46d4-9180-89d97642687b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:47.434965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:47.435616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.435928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.436209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.469649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:47.474129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:47.507915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 826/1658] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:53:47.554175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:47.566660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315df302-0390-44bb-b49c-e295195c9b9d service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:47.572485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:47.573472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.573899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.574390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] PATH_INFO: `/v3/users/be9e848d653f4ee78c01891ef8e8519e` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.575829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9e848d653f4ee78c01891ef8e8519e)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:47.578070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:47.616604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41edb7b542a042b8a628bfb9c3d4795d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.619298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41edb7b542a042b8a628bfb9c3d4795d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.639800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41edb7b542a042b8a628bfb9c3d4795d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.640614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41edb7b542a042b8a628bfb9c3d4795d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.673742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8629741-d70b-4323-8e31-d676ea5a5fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41edb7b542a042b8a628bfb9c3d4795d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.772201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:47.777568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 833/1659] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:46 2022] DELETE /identity/v3/users/41edb7b542a042b8a628bfb9c3d4795d => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:53:47.784733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.785174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.785594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.809451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:47.811081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:47.918349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9e848d653f4ee78c01891ef8e8519e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.925047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 834/1660] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:47.931984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9e848d653f4ee78c01891ef8e8519e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:47.940094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:47.942806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:48.012110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9e848d653f4ee78c01891ef8e8519e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:48.013005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9e848d653f4ee78c01891ef8e8519e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:48.043334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-639d8a70-9178-4f25-98fa-7bea86770894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9e848d653f4ee78c01891ef8e8519e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:48.086937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 827/1661] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:47 2022] DELETE /identity/v3/users/be9e848d653f4ee78c01891ef8e8519e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:53:48.090969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:48.091441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:48.092105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:48.103531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa60b7c-98d2-42e0-900d-02960698a879 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:48.145600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:48.157153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:48.235792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:48.236455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:48.236731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:48.237009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:48.255671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:48.374884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 828/1662] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:48.470335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:48.472266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:48.514489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d603-cdc7-4ab0-a25f-63632815e9d1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:48.529814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:48.539905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:48.539905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:48.539905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] PATH_INFO: `/v3/users/e4ede7edc4914685ba57b26711d08fe0` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:48.540795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:48.540795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:48.540953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ede7edc4914685ba57b26711d08fe0)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:48.546616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:48.577942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 835/1663] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:48.666479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:48.679870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:48.704607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54965f4-6661-42e7-8e08-50f40f7066ec service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:48.727868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:48.731655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ed8b-5a32-40fa-a683-185f4effa343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:48.736237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ed8b-5a32-40fa-a683-185f4effa343 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:48.736534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ed8b-5a32-40fa-a683-185f4effa343 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:48.739453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ed8b-5a32-40fa-a683-185f4effa343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:48.784087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1ed8b-5a32-40fa-a683-185f4effa343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:48.785783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1ed8b-5a32-40fa-a683-185f4effa343 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:48.821609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 836/1664] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:53:48.875062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ede7edc4914685ba57b26711d08fe0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:48.876459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ede7edc4914685ba57b26711d08fe0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:48.985037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ede7edc4914685ba57b26711d08fe0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:48.985855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ede7edc4914685ba57b26711d08fe0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:49.008528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ede7edc4914685ba57b26711d08fe0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:49.055429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 829/1665] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:48 2022] DELETE /identity/v3/users/e4ede7edc4914685ba57b26711d08fe0 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:53:49.060206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:49.060543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:49.060835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:49.119771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:49.121264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:49.138043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:49.214583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 837/1666] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:49.333316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:49.335162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:49.468856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712b7cc-6183-4d36-874e-008348a5c8c6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:49.476031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:49.477177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:49.477609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:49.478275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:49.493432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:49.495225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:49.511333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 830/1667] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:49.887339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:49.889439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:49.912359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a83991-a7c6-49ca-9ca8-2e74c658f54b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:49.917626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:49.919534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:49.925629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:49.926123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] PATH_INFO: `/v3/projects/c68d42e80b964062ba17323e39890a70` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:49.927777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68d42e80b964062ba17323e39890a70)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:49.930006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:50.057721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:50.060037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:50.086406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb311-6817-4660-b2af-65a66e507cf1 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:50.093098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:50.096957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:50.096957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:50.096957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] PATH_INFO: `/v3/projects/0b21f7b11e7b4637998997ab49ec4f00` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:50.098138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b21f7b11e7b4637998997ab49ec4f00)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:50.100450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:50.134304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68d42e80b964062ba17323e39890a70', 'request_id': 'req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.153997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68d42e80b964062ba17323e39890a70', 'request_id': 'req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.169062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68d42e80b964062ba17323e39890a70', 'request_id': 'req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.272624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] The token cache is being invalidate because project c68d42e80b964062ba17323e39890a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:50.276768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.276768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.277632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 838/1668] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:49 2022] DELETE /identity/v3/projects/c68d42e80b964062ba17323e39890a70 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:53:50.281447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:50.284232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:50.313851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b21f7b11e7b4637998997ab49ec4f00', 'request_id': 'req-da800539-6ecf-4a00-af0c-31acf5bf3b05'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.430720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b21f7b11e7b4637998997ab49ec4f00', 'request_id': 'req-da800539-6ecf-4a00-af0c-31acf5bf3b05'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.441392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b21f7b11e7b4637998997ab49ec4f00', 'request_id': 'req-da800539-6ecf-4a00-af0c-31acf5bf3b05'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.476657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] The token cache is being invalidate because project 0b21f7b11e7b4637998997ab49ec4f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:50.477067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.480515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.483365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 831/1669] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:50 2022] DELETE /identity/v3/projects/0b21f7b11e7b4637998997ab49ec4f00 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:50.491155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:50.497195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:50.525425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27798b-f6af-4ae1-81e5-af8c2b8d9d46 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:50.699363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da800539-6ecf-4a00-af0c-31acf5bf3b05 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:50.699545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:50.711939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:50.711939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:50.711939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] PATH_INFO: `/v3/users/17ca03a0b4b946889e7bc6e0db72c0ec` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:50.711939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ca03a0b4b946889e7bc6e0db72c0ec)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:50.712500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:50.712591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:50.712676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:50.712676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:50.712676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] PATH_INFO: `/v3/users/0b4cf13d786c440cba77c535a0f00878` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:50.712676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4cf13d786c440cba77c535a0f00878)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:50.713637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:50.962990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4cf13d786c440cba77c535a0f00878'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.964005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4cf13d786c440cba77c535a0f00878'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.972168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ca03a0b4b946889e7bc6e0db72c0ec'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.973286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ca03a0b4b946889e7bc6e0db72c0ec'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.981613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ca03a0b4b946889e7bc6e0db72c0ec'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.982351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ca03a0b4b946889e7bc6e0db72c0ec'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:50.997593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ca03a0b4b946889e7bc6e0db72c0ec'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.084372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4cf13d786c440cba77c535a0f00878'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.088322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4cf13d786c440cba77c535a0f00878'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.112634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc750f29-bd80-4a5c-b946-ede8209e0567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4cf13d786c440cba77c535a0f00878'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.153536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 832/1670] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:50 2022] DELETE /identity/v3/users/0b4cf13d786c440cba77c535a0f00878 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:51.156119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84144e1-7644-4d77-974c-7e386530ef70 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:51.159446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84144e1-7644-4d77-974c-7e386530ef70 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:51.160250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84144e1-7644-4d77-974c-7e386530ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:51.235164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c84144e1-7644-4d77-974c-7e386530ef70 None None] MFA Rules not processed for user `9e9955f5ee3c4ff7884b2492ea16d3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:51.238806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c84144e1-7644-4d77-974c-7e386530ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:51.242893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 839/1671] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:50 2022] DELETE /identity/v3/users/17ca03a0b4b946889e7bc6e0db72c0ec => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:51.244297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:51.264295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:51.456982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 833/1672] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:51.465271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:51.465746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:51.466100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:51.485670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d0e3-a1c3-4b06-a2bc-a6a2ef10fd90 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:51.492766 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:51.494246 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:51.494928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:51.495394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] PATH_INFO: `/v3/projects/579f99a04f874ff09c2d2b91ac6742d9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:51.497518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579f99a04f874ff09c2d2b91ac6742d9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:51.500012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:51.524860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] MFA Rules not processed for user `9e9955f5ee3c4ff7884b2492ea16d3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:51.532759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:51.553518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 834/1673] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:51.565281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:51.577066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:51.714293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579f99a04f874ff09c2d2b91ac6742d9', 'request_id': 'req-bc5b746a-a4db-4889-9382-59cc996f78c2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.732407 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579f99a04f874ff09c2d2b91ac6742d9', 'request_id': 'req-bc5b746a-a4db-4889-9382-59cc996f78c2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.755251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579f99a04f874ff09c2d2b91ac6742d9', 'request_id': 'req-bc5b746a-a4db-4889-9382-59cc996f78c2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.765083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d38e9-644e-42d1-a2cc-b66574043c95 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:51.773588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:51.872541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] The token cache is being invalidate because project 579f99a04f874ff09c2d2b91ac6742d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:51.872831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.873574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bc5b746a-a4db-4889-9382-59cc996f78c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:51.880008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 840/1674] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:51 2022] DELETE /identity/v3/projects/579f99a04f874ff09c2d2b91ac6742d9 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:51.881906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa103b-482b-4285-9555-b188104e2654 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:51.882204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa103b-482b-4285-9555-b188104e2654 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:51.882488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa103b-482b-4285-9555-b188104e2654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:51.921294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-11fa103b-482b-4285-9555-b188104e2654 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:51.925189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-11fa103b-482b-4285-9555-b188104e2654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:51.929645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:51.930316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:51.930605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:51.930885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:51.937432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:51.943587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:52.070989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 841/1675] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:52.083545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.083872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.084165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.121167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.122884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.136419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:52.140336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:52.163374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 835/1676] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:52.170428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:52.173585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 842/1677] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:52.186087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd435e-cd20-4c0a-9d81-cea70f646ee0 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:52.195653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:52.196412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.196705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.196992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.197891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:52.198741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.200790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.228114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:52.234281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 836/1678] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:52.240137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b3d0-19bc-4a1b-b027-0404f3bfe54a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:52.246540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:52.247397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.247701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.248045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.248742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.251750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.467882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 843/1679] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:52 2022] POST /identity/v3/projects => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:52.471703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:52.487154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df618cb-5d36-4e7d-b417-2249a2e2a8a5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:52.685541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:52.686282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.686557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.686990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.687721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.705594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.730383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:52.733200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:52.761502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46794aab-6b06-4089-9755-ebd72f7e0f7f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:52.784435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:52.785122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.785409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.785691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] PATH_INFO: `/v3/projects/bbfac8e2e2a24e608559642c097ec45b` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.791250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfac8e2e2a24e608559642c097ec45b)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.794050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.808530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 837/1680] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:52 2022] POST /identity/v3/users => generated 286 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:52.812695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:52.841585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c1018-6107-4252-ac18-b5a3343dd39b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:52.863927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:52.864552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.864844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.865128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.870183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.873631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.913408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 838/1681] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:53:52.923585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:52.950838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d23fba-c2d1-4a31-8e73-ead8eaf41b85 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:52.963332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:52.964040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:52.964392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:52.964683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:52.965406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:52.967078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:52.996651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 839/1682] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:52.997597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:53.019224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfac8e2e2a24e608559642c097ec45b', 'request_id': 'req-bf76e839-852f-4114-b7af-1bf939563c17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.022578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eac0d8-c3f0-4e92-9022-516c0fd94fbe admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:53.042967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfac8e2e2a24e608559642c097ec45b', 'request_id': 'req-bf76e839-852f-4114-b7af-1bf939563c17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.050864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfac8e2e2a24e608559642c097ec45b', 'request_id': 'req-bf76e839-852f-4114-b7af-1bf939563c17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.149937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2382ac-a627-4372-a024-c301973d0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:53.150651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2382ac-a627-4372-a024-c301973d0b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.150942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2382ac-a627-4372-a024-c301973d0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.151227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2382ac-a627-4372-a024-c301973d0b93 admin admin] PATH_INFO: `/v3/projects/4951eda54e934b5dba5b675acda2db20/users/0a0bf0127bfd4084aedb8784fa4d2a66/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.165429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] The token cache is being invalidate because project bbfac8e2e2a24e608559642c097ec45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:53.166332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.167284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-bf76e839-852f-4114-b7af-1bf939563c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.171626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 844/1683] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:52 2022] DELETE /identity/v3/projects/bbfac8e2e2a24e608559642c097ec45b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:53:53.188440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2382ac-a627-4372-a024-c301973d0b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4951eda54e934b5dba5b675acda2db20, user_id=0a0bf0127bfd4084aedb8784fa4d2a66, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:53.189209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.189510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.189796 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.196986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2382ac-a627-4372-a024-c301973d0b93 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:53.248892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:53.250173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:53.271873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 845/1684] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:53.272921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:53.274481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:53.306949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 840/1685] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:52 2022] PUT /identity/v3/projects/4951eda54e934b5dba5b675acda2db20/users/0a0bf0127bfd4084aedb8784fa4d2a66/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:53.308542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893c18-c578-4c42-a266-fa5f9cf8aa7f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.310097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893c18-c578-4c42-a266-fa5f9cf8aa7f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.310097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893c18-c578-4c42-a266-fa5f9cf8aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.327060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18959d49-69f7-4db1-89ad-9f83c2ef5f02 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:53.355210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c6893c18-c578-4c42-a266-fa5f9cf8aa7f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:53.356782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c6893c18-c578-4c42-a266-fa5f9cf8aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:53.520449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 841/1686] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:53.521958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.524523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.524853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.538874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:53.539561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.542591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.542591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] PATH_INFO: `/v3/users/cc5910761e914b339984f443364f5272` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.544194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5910761e914b339984f443364f5272)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:53.549725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:53.571268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:53.598630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] MFA Rules not processed for user `0a0bf0127bfd4084aedb8784fa4d2a66`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:53.601654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:53.619003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:53.762844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 842/1687] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:53.764180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:53.778480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397163b-8d01-495b-928c-9a02db5b4800 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:53.792493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:53.794822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.795337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.795863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.798804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:53.801909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:53.805650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:53.823338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 843/1688] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:53.824727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:53.827160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:53.850702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5910761e914b339984f443364f5272'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.850937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5910761e914b339984f443364f5272'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.873486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08559-c51d-4259-9f31-4eacb9e202f8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:53.878566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5910761e914b339984f443364f5272'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.880503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5910761e914b339984f443364f5272'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:53.883423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fc068-89ad-40f1-8603-d6b9b4aec269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:53.884251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc068-89ad-40f1-8603-d6b9b4aec269 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:53.884668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc068-89ad-40f1-8603-d6b9b4aec269 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:53.887320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc068-89ad-40f1-8603-d6b9b4aec269 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:53.888260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fc068-89ad-40f1-8603-d6b9b4aec269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:53.895675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fc068-89ad-40f1-8603-d6b9b4aec269 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:53.912872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5910761e914b339984f443364f5272'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:54.054531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 846/1689] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:53 2022] DELETE /identity/v3/users/cc5910761e914b339984f443364f5272 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:54.056186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:54.062725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:54.097550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 844/1690] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:53 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:54.099990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.101872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.104559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.175146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:54.175146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:54.217298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f796b5-57ce-4123-b1b3-11716d00db9b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:54.293060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 845/1691] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:54.294224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:54.301097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:54.345397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203574b-0d0d-436c-908b-6bee0b3e7e30 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:54.345397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca17db-c3ea-4631-a97b-7540ad4d9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:54.345397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca17db-c3ea-4631-a97b-7540ad4d9bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.345397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca17db-c3ea-4631-a97b-7540ad4d9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.346092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca17db-c3ea-4631-a97b-7540ad4d9bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.347030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca17db-c3ea-4631-a97b-7540ad4d9bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:54.350016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca17db-c3ea-4631-a97b-7540ad4d9bc6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:54.369839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5367dd-abd8-4433-b5a9-e56d82e466d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:54.370906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5367dd-abd8-4433-b5a9-e56d82e466d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.371445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5367dd-abd8-4433-b5a9-e56d82e466d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.372288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5367dd-abd8-4433-b5a9-e56d82e466d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.373244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5367dd-abd8-4433-b5a9-e56d82e466d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:54.380517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5367dd-abd8-4433-b5a9-e56d82e466d0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:54.519357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 846/1692] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:54 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:54.520822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.521241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.521663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.524238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 847/1693] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:54 2022] POST /identity/v3/projects => generated 379 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:54.525665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415fa3-17bf-451a-a97f-ce08c59f065d None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.535469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415fa3-17bf-451a-a97f-ce08c59f065d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.535911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415fa3-17bf-451a-a97f-ce08c59f065d None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.537779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 848/1694] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 25 22:53:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:54.543199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415fa3-17bf-451a-a97f-ce08c59f065d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:54.545941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-96415fa3-17bf-451a-a97f-ce08c59f065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:54.614975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] MFA Rules not processed for user `0940cde66b1247b89a34b60a3dbe3452`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:54.616390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:54.717116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415fa3-17bf-451a-a97f-ce08c59f065d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:54.739396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:54.740095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.740507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.740961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.838484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 847/1695] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:54.845077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:54.921733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:54.923828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:54.954532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 849/1696] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:54.957110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:54.981906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213081b-ad6b-452c-b9d4-7ece3d7ff898 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:54.994898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:54.995551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:54.995874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:54.996166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:54.996844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:54.998573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d38fd-ddc2-4dc5-b13f-a70e3242636c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:55.005226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:55.020282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d82bf-b04f-4ce4-9b82-1828ff135c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:55.020933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d82bf-b04f-4ce4-9b82-1828ff135c57 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.021221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d82bf-b04f-4ce4-9b82-1828ff135c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.021500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d82bf-b04f-4ce4-9b82-1828ff135c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.022217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d82bf-b04f-4ce4-9b82-1828ff135c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:55.026730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d82bf-b04f-4ce4-9b82-1828ff135c57 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:55.057760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 848/1697] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:55.064369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04eb91-59c7-405e-90d4-46c7948ba082 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.065331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04eb91-59c7-405e-90d4-46c7948ba082 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.065604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04eb91-59c7-405e-90d4-46c7948ba082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.174810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 850/1698] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:54 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:55.178578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:55.196826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.199463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-7a04eb91-59c7-405e-90d4-46c7948ba082 None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:55.210344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7a04eb91-59c7-405e-90d4-46c7948ba082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.235373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b908-478f-4e36-8363-17552efef664 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:55.241443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 849/1699] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:53:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:55.242746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.243042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.243325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.254761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:55.256673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.256973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.257348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] PATH_INFO: `/v3/projects/cd3e9298c5ff4cedaf3a8d1110b1bde5` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.262296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3e9298c5ff4cedaf3a8d1110b1bde5)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:55.266018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:55.302125 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] MFA Rules not processed for user `0940cde66b1247b89a34b60a3dbe3452`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:55.308350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.320467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 850/1700] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:55.322247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:55.351444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3432035-9299-4ea7-8580-bf30c9b84661 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:55.358140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:55.361392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.362083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.362567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] PATH_INFO: `/v3/projects/7a0129c12bb742c4b0b30cc629826f6e/users/13f642110a45402bbf1bfabc20969d8a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.391847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0129c12bb742c4b0b30cc629826f6e, user_id=13f642110a45402bbf1bfabc20969d8a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:55.396159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:55.421181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:55.473113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 851/1701] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:55 2022] PUT /identity/v3/projects/7a0129c12bb742c4b0b30cc629826f6e/users/13f642110a45402bbf1bfabc20969d8a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:55.476541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:55.502770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3e9298c5ff4cedaf3a8d1110b1bde5', 'request_id': 'req-b248d81f-1baa-40b5-b205-dcccb02c6315'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:55.526463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3e9298c5ff4cedaf3a8d1110b1bde5', 'request_id': 'req-b248d81f-1baa-40b5-b205-dcccb02c6315'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:55.542393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3e9298c5ff4cedaf3a8d1110b1bde5', 'request_id': 'req-b248d81f-1baa-40b5-b205-dcccb02c6315'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:55.558454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:55.605746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dbee9-a066-4318-a28c-86a8df8d0763 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:55.617113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] The token cache is being invalidate because project cd3e9298c5ff4cedaf3a8d1110b1bde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:55.617496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:55.618352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b248d81f-1baa-40b5-b205-dcccb02c6315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:55.626466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 851/1702] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:55 2022] DELETE /identity/v3/projects/cd3e9298c5ff4cedaf3a8d1110b1bde5 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:55.628488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.628780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.629063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.694753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] MFA Rules not processed for user `7c4dee65a8054f028fae113d5c31406e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:55.696356 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.749185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:55.749185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.752128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.752575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.753325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:55.761461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:55.790366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 852/1703] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:55.791350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:55.794761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.843379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 852/1704] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:55.845650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:55.863487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.918941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95de4-8075-44db-8246-3f7865d3142f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:55.933114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:55.934770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:55.936978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:55.943034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:55.946030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:55.977335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:55.984428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:55.997392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:56.010837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 853/1705] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:56.011679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:56.028147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aee80-595d-49c2-8bff-4a4c439b61b6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:56.032438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.036738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:56.037522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.038031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.038183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.042390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.076446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f875f24-73be-489a-ae46-7228326ff12c service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:56.090844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b2854-df9c-4ae9-b873-c2ba3f46ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:56.092077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2854-df9c-4ae9-b873-c2ba3f46ac56 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.092319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2854-df9c-4ae9-b873-c2ba3f46ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.093210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b2854-df9c-4ae9-b873-c2ba3f46ac56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.096266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b2854-df9c-4ae9-b873-c2ba3f46ac56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:56.100971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b2854-df9c-4ae9-b873-c2ba3f46ac56 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:56.131867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 854/1706] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:56.133342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.136211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.136520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.155842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:56.158614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:56.176123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 853/1707] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:56.177532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:56.179443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.188255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:56.192156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.209633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560ba7-3540-40c4-9b23-75e765f08ea6 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:56.217157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 855/1708] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:56.221337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:56.223809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762faeae-0508-4f8c-b917-44358c1d78d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:56.224811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762faeae-0508-4f8c-b917-44358c1d78d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.225241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762faeae-0508-4f8c-b917-44358c1d78d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.225704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762faeae-0508-4f8c-b917-44358c1d78d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.226576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762faeae-0508-4f8c-b917-44358c1d78d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:56.229847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762faeae-0508-4f8c-b917-44358c1d78d3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:56.270182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c64e9-67c2-40b0-a00f-a1bb2d76c5e4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:56.270492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 854/1709] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:56.273215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71de5-5652-43e4-8a9e-ee1726423fda None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.276990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71de5-5652-43e4-8a9e-ee1726423fda None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.277475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71de5-5652-43e4-8a9e-ee1726423fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.283310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:56.284166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.284533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.285155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] PATH_INFO: `/v3/projects/7a0129c12bb742c4b0b30cc629826f6e/users/13f642110a45402bbf1bfabc20969d8a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.289654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0129c12bb742c4b0b30cc629826f6e, user_id=13f642110a45402bbf1bfabc20969d8a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:56.293377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:56.353700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 856/1710] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:56 2022] PUT /identity/v3/projects/7a0129c12bb742c4b0b30cc629826f6e/users/13f642110a45402bbf1bfabc20969d8a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:56.353700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:56.363290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:56.365354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-28a71de5-5652-43e4-8a9e-ee1726423fda None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:56.372530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-28a71de5-5652-43e4-8a9e-ee1726423fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.478704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdedb9-d234-477c-b561-f2ab2f552b37 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:56.484257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:56.485777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.486276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.486734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] PATH_INFO: `/v3/projects/09cb86d470c64a4fb649c418a890f280/users/a4bc556fb6b24cd38b8175bc9adc6e12/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.507426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cb86d470c64a4fb649c418a890f280, user_id=a4bc556fb6b24cd38b8175bc9adc6e12, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:56.511506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:56.544994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 855/1711] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:56.544994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfae7d-9cbf-44b1-9be9-6d1c3ab320fc None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.544994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfae7d-9cbf-44b1-9be9-6d1c3ab320fc None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.544994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfae7d-9cbf-44b1-9be9-6d1c3ab320fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.555046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:56.637497 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 857/1712] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:56 2022] PUT /identity/v3/projects/09cb86d470c64a4fb649c418a890f280/users/a4bc556fb6b24cd38b8175bc9adc6e12/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:56.637695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-edcfae7d-9cbf-44b1-9be9-6d1c3ab320fc None None] MFA Rules not processed for user `13f642110a45402bbf1bfabc20969d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:56.639201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:56.650916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-edcfae7d-9cbf-44b1-9be9-6d1c3ab320fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.835917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671ed5-ed68-4b22-92ed-20a89f53815c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:56.848479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:56.851949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.852290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.852575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.853339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:56.853947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:56.863115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:56.874287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 856/1713] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:56.880335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:56.881683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:56.882162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:56.903843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 858/1714] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:56.907493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:56.910987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:56.965807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] MFA Rules not processed for user `a4bc556fb6b24cd38b8175bc9adc6e12`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:56.976559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:57.107650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7f0c-baf9-4269-9ba4-da42a42d0c4b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:57.114580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 857/1715] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:57.118279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:57.119875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:57.120901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:57.121230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:57.121520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:57.140689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d8b3e-8513-4491-b857-9738597f60c4 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:57.150011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:57.150252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:57.150941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:57.151339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:57.151626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:57.152252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:57.153248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:57.157470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:57.183641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 859/1716] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:57.184652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:57.186120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:57.220959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de2d2-ef3f-4608-a261-3ede30dd4349 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:57.244277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:57.245404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:57.247901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:57.248351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] PATH_INFO: `/v3/projects/11381c13ef7b4e0088fc9271c688d6d9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:57.255935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11381c13ef7b4e0088fc9271c688d6d9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:57.259433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:57.305217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 858/1717] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:57 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:57.306951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:57.549335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072593a6-ef40-48ab-ba72-e14991ea2db1 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:57.560816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11381c13ef7b4e0088fc9271c688d6d9', 'request_id': 'req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:57.670742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11381c13ef7b4e0088fc9271c688d6d9', 'request_id': 'req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:57.681377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11381c13ef7b4e0088fc9271c688d6d9', 'request_id': 'req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:57.708481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] The token cache is being invalidate because project 11381c13ef7b4e0088fc9271c688d6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:53:57.708481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:57.708481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:57.711817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 860/1718] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:53:57 2022] DELETE /identity/v3/projects/11381c13ef7b4e0088fc9271c688d6d9 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:57.712824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:57.714649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:57.728654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6eb32-d8c4-4285-87e5-a9e3484296f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:57.729688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6eb32-d8c4-4285-87e5-a9e3484296f1 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:57.730140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6eb32-d8c4-4285-87e5-a9e3484296f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:57.730558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6eb32-d8c4-4285-87e5-a9e3484296f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:57.732687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6eb32-d8c4-4285-87e5-a9e3484296f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:57.737267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6eb32-d8c4-4285-87e5-a9e3484296f1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:57.865638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 859/1719] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:57 2022] POST /identity/v3/projects => generated 377 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:57.866210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949841-1507-41ed-b9a4-798d66a872ba None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:57.873633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949841-1507-41ed-b9a4-798d66a872ba None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:57.873633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949841-1507-41ed-b9a4-798d66a872ba None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:57.873633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 860/1720] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 25 22:53:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:57.873633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:57.873633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:57.873633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:57.887312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bdcd3-11ee-46b2-8f03-37eb9835c75f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:57.910875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:57.912168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.023469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.024229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.024516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.024798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.025487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.027586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.059067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 861/1721] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:58.060023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.069381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.166743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 861/1722] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:57 2022] POST /identity/v3/users => generated 292 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:58.167607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.173814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.198439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2489911-6ea7-4f23-b7bf-eb6bbd68f0df admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.198837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef688ba-b222-49c5-9908-9c6ce43b4c13 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.205948 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ea1e-822a-4491-8b61-0626d38343c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.206360 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.206884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ea1e-822a-4491-8b61-0626d38343c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.207007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.207271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.207413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ea1e-822a-4491-8b61-0626d38343c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.207546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.208771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ea1e-822a-4491-8b61-0626d38343c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.209578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ea1e-822a-4491-8b61-0626d38343c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.209683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.213268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ea1e-822a-4491-8b61-0626d38343c9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.242353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:58.286010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.287877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ceaac-662f-4219-8d94-b2e9c0a5c3dd service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.309520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 862/1723] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:58.310844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61363fa-5417-436d-8add-1cfdc0eabc1f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.311475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61363fa-5417-436d-8add-1cfdc0eabc1f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.312087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61363fa-5417-436d-8add-1cfdc0eabc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.352663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e61363fa-5417-436d-8add-1cfdc0eabc1f None None] MFA Rules not processed for user `7f54b07b4dbc4e67b44a1c3ff6d60226`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:58.354254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e61363fa-5417-436d-8add-1cfdc0eabc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.365466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 862/1724] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:53:58 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:58.366976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875c8c-b0f7-4516-84cc-ac8098d3e416 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.368550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875c8c-b0f7-4516-84cc-ac8098d3e416 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.368990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875c8c-b0f7-4516-84cc-ac8098d3e416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.399344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-48875c8c-b0f7-4516-84cc-ac8098d3e416 None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:58.400869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-48875c8c-b0f7-4516-84cc-ac8098d3e416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.475777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 863/1725] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:58.478319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 863/1726] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:53:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:58.480198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.480542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.480824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.483422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717dca-74f7-4572-b26c-45cbf530fb11 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.483776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717dca-74f7-4572-b26c-45cbf530fb11 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.484075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717dca-74f7-4572-b26c-45cbf530fb11 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.493324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 864/1727] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jul 25 22:53:58 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:58.494892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4717dca-74f7-4572-b26c-45cbf530fb11 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.530161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4717dca-74f7-4572-b26c-45cbf530fb11 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.533283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:58.536866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44357267-56be-436c-91ec-0e881d1ad6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.537026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.537683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44357267-56be-436c-91ec-0e881d1ad6ca admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.538133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44357267-56be-436c-91ec-0e881d1ad6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.538422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44357267-56be-436c-91ec-0e881d1ad6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.539180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44357267-56be-436c-91ec-0e881d1ad6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.542243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44357267-56be-436c-91ec-0e881d1ad6ca admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.560869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 864/1728] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:58.560869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.561092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 865/1729] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:58.561296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.561500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.561781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.589767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9ff1e-b916-4137-846b-4876ece194da None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.595785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:58.596020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.598232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.598899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.599388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.599960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.601094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.602974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.628381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 865/1730] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:58.631989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.637849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.668630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1a31-6de0-477c-9eb7-a2bbb9c2cce5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.673159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.674310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.674706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.675176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.684956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.689012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.695966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 866/1731] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jul 25 22:53:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:58.697008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.709620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae1eb-faa4-41c7-b711-1b07cbcdee5d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.712387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 866/1732] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:58.713954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.721582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.722391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.723003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.724863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:58.725725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.727306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:53:58.727793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.732410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.741108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f61e-e90e-4cc4-9bda-9b2c56890664 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.752932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 867/1733] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:53:58.755406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.760254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:58.784302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.785077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.789709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.789709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.789709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.789709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.809419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6881-ba72-4698-8b22-9f796ebecc53 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.818295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 867/1734] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:53:58.818468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.818574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:58.818678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.818762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.818993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] PATH_INFO: `/v3/users/0a0bf0127bfd4084aedb8784fa4d2a66` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.821221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0bf0127bfd4084aedb8784fa4d2a66)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.823834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.830032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edb22c-d305-4578-8eb0-3d87ddd4a3b7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:58.836245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:58.837602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:58.841562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:58.841562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] PATH_INFO: `/v3/projects/4638b5da18b54bc18e7ab191c4524ad4/users/b3bbe130721c4bbeabd02411683be275/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:58.862920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4638b5da18b54bc18e7ab191c4524ad4, user_id=b3bbe130721c4bbeabd02411683be275, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:58.867374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:58.963942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 868/1735] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:58 2022] PUT /identity/v3/projects/4638b5da18b54bc18e7ab191c4524ad4/users/b3bbe130721c4bbeabd02411683be275/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:58.964993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:59.083286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0bf0127bfd4084aedb8784fa4d2a66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:59.084917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0bf0127bfd4084aedb8784fa4d2a66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:59.100691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0bf0127bfd4084aedb8784fa4d2a66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:59.100691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0bf0127bfd4084aedb8784fa4d2a66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:59.123716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159478ce-591f-45a0-8727-a50271d8d9ab admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:59.128263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0bf0127bfd4084aedb8784fa4d2a66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:53:59.138458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:59.139781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:59.140177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:59.140586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:59.143299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.225019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:59.227133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:59.250059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 868/1736] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:53:58 2022] DELETE /identity/v3/users/0a0bf0127bfd4084aedb8784fa4d2a66 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:59.250059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:59.252830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.255231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 869/1737] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:59.257608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:59.262049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.394462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a527e-c075-4065-b81e-aaa723d2d836 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:59.413551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:59.419469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:59.420036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:59.420414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:59.424437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33afea-d3ba-4c41-9d14-11d9b36e7f7e service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:59.425316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.447409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:59.450777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:59.470200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 869/1738] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:59.471179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:59.472842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.522575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:59.634539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:59.635246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:59.635500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:59.640307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:59.641159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:59.643713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:59.684131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30eef5-0209-40a0-b7c7-7b1cca8fada9 service placement] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:59.702959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc974cdf-0432-40c1-be89-e2cfa57730e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:59.708472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc974cdf-0432-40c1-be89-e2cfa57730e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:59.709075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc974cdf-0432-40c1-be89-e2cfa57730e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:59.711431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc974cdf-0432-40c1-be89-e2cfa57730e4 admin admin] PATH_INFO: `/v3/projects/5de15f40eea54d88b3738d9ea29d8c74/users/3c3d96daf26c471385c6a8af76d5f51a/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:59.738973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc974cdf-0432-40c1-be89-e2cfa57730e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de15f40eea54d88b3738d9ea29d8c74, user_id=3c3d96daf26c471385c6a8af76d5f51a, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:59.748265 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc974cdf-0432-40c1-be89-e2cfa57730e4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:59.781258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 870/1739] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:53:59 2022] POST /identity/v3/projects => generated 371 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:53:59.781258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:59.785055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.867179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 870/1740] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:53:59 2022] PUT /identity/v3/projects/5de15f40eea54d88b3738d9ea29d8c74/users/3c3d96daf26c471385c6a8af76d5f51a/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:53:59.867179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfe47-5d00-4fa6-92a4-f43e912ae9e9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:59.867179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfe47-5d00-4fa6-92a4-f43e912ae9e9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:59.867179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfe47-5d00-4fa6-92a4-f43e912ae9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:59.887955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:59.916729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bf4cfe47-5d00-4fa6-92a4-f43e912ae9e9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:59.918075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bf4cfe47-5d00-4fa6-92a4-f43e912ae9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:59.987296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e926dc9-ca13-44f3-a925-d0ebe0cf16ca admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:00.071620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 871/1741] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:00.074920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5df72e-e13f-44bf-aed8-dbb877a352cf None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.074920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5df72e-e13f-44bf-aed8-dbb877a352cf None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.074920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5df72e-e13f-44bf-aed8-dbb877a352cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.097451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-dd5df72e-e13f-44bf-aed8-dbb877a352cf None None] MFA Rules not processed for user `0940cde66b1247b89a34b60a3dbe3452`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:00.099359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-dd5df72e-e13f-44bf-aed8-dbb877a352cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:00.113375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:00.122226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.122726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.123014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.126188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:00.127890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:00.151620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 871/1742] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:00.152525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:00.178119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b807037-8031-4390-b225-6c47361184e4 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:00.185845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:00.187175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.187521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.187893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.188792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:00.190902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:00.221486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 872/1743] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:00.222934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.223351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.223739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.275366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] MFA Rules not processed for user `3c3d96daf26c471385c6a8af76d5f51a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:00.278296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:00.303025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 872/1744] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:00 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:00.304028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:00.310425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:00.490325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e286c3-f2de-4f70-bfe4-b8f6e4ece62f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:00.508568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:00.512221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.512437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.512708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.565191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:00.576819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:00.606411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 873/1745] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:00.607153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:00.633214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 873/1746] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:00.633214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:00.642472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23c34-ad53-446a-a0d7-5087878c2d52 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:00.664672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:00.667879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.668241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.669332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] PATH_INFO: `/v3/projects/4638b5da18b54bc18e7ab191c4524ad4/users/b3bbe130721c4bbeabd02411683be275/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.675127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4638b5da18b54bc18e7ab191c4524ad4, user_id=b3bbe130721c4bbeabd02411683be275, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:00.681979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:00.690929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf9bd-6f30-47e0-afea-493e625da568 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:00.697571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:00.713448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa15de-cc86-403e-a1a2-98d4681db85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:00.717644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa15de-cc86-403e-a1a2-98d4681db85e admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.724488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 874/1747] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:00 2022] PUT /identity/v3/projects/4638b5da18b54bc18e7ab191c4524ad4/users/b3bbe130721c4bbeabd02411683be275/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:00.724678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa15de-cc86-403e-a1a2-98d4681db85e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.724678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa15de-cc86-403e-a1a2-98d4681db85e admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.724858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:00.727704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa15de-cc86-403e-a1a2-98d4681db85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:00.736173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa15de-cc86-403e-a1a2-98d4681db85e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:00.800609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 874/1748] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:00.803510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.805654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.808122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.895014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a512-7360-4a50-85bd-7f396c94e318 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:00.907863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:00.908537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:00.908829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:00.909573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:00.910283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:00.915354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:00.926352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] MFA Rules not processed for user `b3bbe130721c4bbeabd02411683be275`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:00.929748 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:01.092501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 875/1749] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:00 2022] POST /identity/v3/projects => generated 383 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:01.093496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:01.145061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 875/1750] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:01.145061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:01.159787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57502aa-1b6c-4715-bbde-cd3b80344a2a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:01.253726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f88ab-dcaa-41fd-a76d-9a5ac1956238 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:01.269649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:01.271599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.272548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.317287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:01.318394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:01.321207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:01.346543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 876/1751] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:01.348286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:01.351307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:01.353515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:01.354173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.354467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.354903 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:01.359180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:01.362127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:01.501250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 876/1752] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:01 2022] POST /identity/v3/users => generated 298 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:01.502361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:01.529513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b29fe-e52e-4c72-a31b-2ec7cf79a3fd admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:01.536143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5b0ba-8469-4614-ad75-af9ec0cacef2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:01.542237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:01.544917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.546283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.546715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] PATH_INFO: `/v3/projects/669224039f294696b89ec0e0ab995406/users/3bac1ba7c72c40d7aea3bfd3048a8d1e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:01.547895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:01.554123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.554422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.554914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:01.561619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:01.575602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669224039f294696b89ec0e0ab995406, user_id=3bac1ba7c72c40d7aea3bfd3048a8d1e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:01.582883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:01.601307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:01.677634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 877/1753] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:01 2022] PUT /identity/v3/projects/669224039f294696b89ec0e0ab995406/users/3bac1ba7c72c40d7aea3bfd3048a8d1e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:01.677634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:01.767437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:01.767437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce558e9d-782b-4444-833b-4d19d6d37688 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:01.780537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 877/1754] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:01.786688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.788252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.789937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:01.855358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c844e-6dbb-4bca-9653-c6632df1dd44 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:01.857360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] MFA Rules not processed for user `3bac1ba7c72c40d7aea3bfd3048a8d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:01.858905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:01.869254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:01.870177 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.871615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.875002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:01.875002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:01.877417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:01.909077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 878/1755] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:01.911348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:01.936419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e61ef-e072-474e-b2b7-cb52f93dbd81 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:01.949365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:01.951100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:01.951691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:01.955219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] PATH_INFO: `/v3/projects/622da35a9167409099d832f5da23faa5/users/25c91d0f534242e987cb44810d3b4569/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.052590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 878/1756] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:02.053868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:02.067902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622da35a9167409099d832f5da23faa5, user_id=25c91d0f534242e987cb44810d3b4569, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:02.071383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:02.076738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ca8d0-56f1-44a6-b747-ee11bd2169ba None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:02.102224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:02.103167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:02.103747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:02.104166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.105137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:02.107413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:02.145626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:02.209314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 879/1757] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:01 2022] PUT /identity/v3/projects/622da35a9167409099d832f5da23faa5/users/25c91d0f534242e987cb44810d3b4569/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:02.213001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:02.241167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 879/1758] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:02 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:02.245777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:02.407634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f8a7-03c0-434c-8bd9-2023df08d0cf admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:02.418795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f4b95-7a81-40e0-a0cc-504c972efad6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:02.419982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087767f-c441-4bfa-9665-a9926ae46073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:02.421579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087767f-c441-4bfa-9665-a9926ae46073 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:02.421579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087767f-c441-4bfa-9665-a9926ae46073 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:02.421579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087767f-c441-4bfa-9665-a9926ae46073 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.424023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087767f-c441-4bfa-9665-a9926ae46073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:02.428219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:02.429636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:02.430072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:02.430414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087767f-c441-4bfa-9665-a9926ae46073 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:02.435818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.435818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:02.435818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:02.451260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 880/1759] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:54:02.455320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:02.472914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753dca5-bbd0-4596-b2c3-4cf43bb95dde admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:02.486505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:02.487223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:02.487583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:02.487887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] PATH_INFO: `/v3/projects/622da35a9167409099d832f5da23faa5/users/25c91d0f534242e987cb44810d3b4569/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.492179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622da35a9167409099d832f5da23faa5, user_id=25c91d0f534242e987cb44810d3b4569, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:02.494851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:02.544020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 881/1760] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:02 2022] PUT /identity/v3/projects/622da35a9167409099d832f5da23faa5/users/25c91d0f534242e987cb44810d3b4569/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:02.547070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:02.551641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:02.592141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 880/1761] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:02 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:02.592141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:02.601371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:02.602539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.721186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] MFA Rules not processed for user `25c91d0f534242e987cb44810d3b4569`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:02.725344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:02.729743 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:02.791539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ecdf0-b1f8-424c-b7a0-0aec3caa2028 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:02.809481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:02.810056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:02.810347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:02.810620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] PATH_INFO: `/v3/projects/4951eda54e934b5dba5b675acda2db20` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:02.812025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4951eda54e934b5dba5b675acda2db20)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:02.814554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:03.043956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 881/1762] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:03.043956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:03.086674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77298da5-2a13-42df-92f1-5d52fea0fc9a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:03.104666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4951eda54e934b5dba5b675acda2db20', 'request_id': 'req-71933b5f-4b20-4644-bc74-369020fbc8c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.128538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4951eda54e934b5dba5b675acda2db20', 'request_id': 'req-71933b5f-4b20-4644-bc74-369020fbc8c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.158232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4951eda54e934b5dba5b675acda2db20', 'request_id': 'req-71933b5f-4b20-4644-bc74-369020fbc8c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.252264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] The token cache is being invalidate because project 4951eda54e934b5dba5b675acda2db20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:03.252765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.254463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.263264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 882/1763] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:02 2022] DELETE /identity/v3/projects/4951eda54e934b5dba5b675acda2db20 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:03.264044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:03.264926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:03.265043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:03.265660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:03.266233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:03.270101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:03.273676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:03.274882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:03.318035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 882/1764] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:03.319320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:03.329543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:03.352887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2f949-9389-4de6-b617-8599cd558c9d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:03.362201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:03.379835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:03.380139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:03.380434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] PATH_INFO: `/v3/users/13f642110a45402bbf1bfabc20969d8a` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:03.386067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f642110a45402bbf1bfabc20969d8a)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:03.403866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:03.529532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933b5f-4b20-4644-bc74-369020fbc8c7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:03.534069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:03.535063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:03.535599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:03.536078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:03.543699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:03.749932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:03.751464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:03.786937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f642110a45402bbf1bfabc20969d8a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.788285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f642110a45402bbf1bfabc20969d8a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.796356 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:03.802749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 883/1765] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:03.803678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:03.805572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:03.835830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d957db-4193-44a6-948c-4a3308c41609 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:03.854588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:03.856808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:03.857101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:03.857443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] PATH_INFO: `/v3/projects/921a9c55273f48e9a0a66f66eb63857f/users/a463c4e9cbf945399acf432051a67ca1/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:03.913632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921a9c55273f48e9a0a66f66eb63857f, user_id=a463c4e9cbf945399acf432051a67ca1, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:03.919955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:03.949715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f642110a45402bbf1bfabc20969d8a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.950480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f642110a45402bbf1bfabc20969d8a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:03.992941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f642110a45402bbf1bfabc20969d8a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:04.027075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 884/1766] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:03 2022] PUT /identity/v3/projects/921a9c55273f48e9a0a66f66eb63857f/users/a463c4e9cbf945399acf432051a67ca1/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:04.030862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:04.034850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:04.053171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 883/1767] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:03 2022] DELETE /identity/v3/users/13f642110a45402bbf1bfabc20969d8a => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:04.053597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:04.057954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:04.268820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:04.309970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830e67d-cd3e-4b3c-b356-b44873f0ea78 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:04.314190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58adb4-0c1b-4e66-9acd-1d8e96c0c23f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:04.336407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:04.339494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:04.340080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:04.341244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:04.349112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:04.599605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:04.604187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:04.605754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:04.606261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:04.608918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:04.616168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:04.650775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:04.656142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:04.661798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 885/1768] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:04.662974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:04.666031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:04.685497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1b59-c886-4838-8456-57a5df6a2063 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:04.688108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 884/1769] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:04.690272 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:04.690580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:04.691274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:04.707946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:04.708431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:04.715687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:04.724297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:04.737155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a037b6-0cd8-44bf-b0b1-f46b6085f967 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:04.746107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3df81-6e01-40f2-adea-a560976a8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:04.749860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3df81-6e01-40f2-adea-a560976a8c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:04.749860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3df81-6e01-40f2-adea-a560976a8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:04.749860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3df81-6e01-40f2-adea-a560976a8c57 admin admin] PATH_INFO: `/v3/projects/921a9c55273f48e9a0a66f66eb63857f/users/a463c4e9cbf945399acf432051a67ca1/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:04.757035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3df81-6e01-40f2-adea-a560976a8c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921a9c55273f48e9a0a66f66eb63857f, user_id=a463c4e9cbf945399acf432051a67ca1, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:04.759823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3df81-6e01-40f2-adea-a560976a8c57 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:04.796558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 885/1770] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:04 2022] PUT /identity/v3/projects/921a9c55273f48e9a0a66f66eb63857f/users/a463c4e9cbf945399acf432051a67ca1/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:04.807317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd452-771d-42c5-9c2d-b3cead50797d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:04.807317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd452-771d-42c5-9c2d-b3cead50797d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:04.807317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd452-771d-42c5-9c2d-b3cead50797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:04.870838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-455cd452-771d-42c5-9c2d-b3cead50797d None None] MFA Rules not processed for user `a463c4e9cbf945399acf432051a67ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:04.876187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-455cd452-771d-42c5-9c2d-b3cead50797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:04.893716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:04.895678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:04.914387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 886/1771] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:05.130665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 886/1772] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:05.223160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:05.235285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282382-aba6-4be1-a845-182c24d5f756 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:05.383977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:05.384646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:05.384935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:05.385215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:05.415805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:05.417147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:05.452679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 887/1773] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:05.581786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:05.582401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:05.582839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:05.654103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] MFA Rules not processed for user `7c4dee65a8054f028fae113d5c31406e`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:05.657837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:05.864879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 887/1774] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:06.064326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:06.068165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:06.139980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:06.269119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:06.288264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8908f-5fe5-4e57-9165-20c7a4f1d0fa None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:06.315717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:06.322641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:06.328949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:06.328949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:06.334298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:06.399858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052cfa9-ca74-470d-b37d-ce8c5ce4d3e1 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:06.416108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:06.417355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:06.417830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:06.418517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] PATH_INFO: `/v3/projects/7a0129c12bb742c4b0b30cc629826f6e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:06.421152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0129c12bb742c4b0b30cc629826f6e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:06.425931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:06.487973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:06.489949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae304cb-5b3c-4dfd-8b7b-1263b2b19dd6 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:06.520190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 888/1775] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:06.559683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cfec2-6a5d-410c-9d31-3de1bcb74c66 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:06.564912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cfec2-6a5d-410c-9d31-3de1bcb74c66 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:06.567517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cfec2-6a5d-410c-9d31-3de1bcb74c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:06.599877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0129c12bb742c4b0b30cc629826f6e', 'request_id': 'req-559289ec-db7c-4700-a288-d33a7e3ac2af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:06.612247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0129c12bb742c4b0b30cc629826f6e', 'request_id': 'req-559289ec-db7c-4700-a288-d33a7e3ac2af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:06.630857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0129c12bb742c4b0b30cc629826f6e', 'request_id': 'req-559289ec-db7c-4700-a288-d33a7e3ac2af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:06.757144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] The token cache is being invalidate because project 7a0129c12bb742c4b0b30cc629826f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:06.757515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:06.758167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-559289ec-db7c-4700-a288-d33a7e3ac2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:06.762459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-042cfec2-6a5d-410c-9d31-3de1bcb74c66 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:06.763354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 888/1776] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:06 2022] DELETE /identity/v3/projects/7a0129c12bb742c4b0b30cc629826f6e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:06.764869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae1193-d0a5-4028-a15d-5caab4059e6e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:06.765163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae1193-d0a5-4028-a15d-5caab4059e6e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:06.765320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-042cfec2-6a5d-410c-9d31-3de1bcb74c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:06.765442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae1193-d0a5-4028-a15d-5caab4059e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:06.820117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0bae1193-d0a5-4028-a15d-5caab4059e6e None None] MFA Rules not processed for user `7f54b07b4dbc4e67b44a1c3ff6d60226`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:06.831606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0bae1193-d0a5-4028-a15d-5caab4059e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:06.916817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 889/1777] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:06.933005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:06.934713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:06.935340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:06.956707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 889/1778] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:07.011556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:07.012844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:07.164930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 890/1779] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:07.171454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.172032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.172306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.256000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:07.256000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:07.268592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 890/1780] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:07.271443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.285526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491322c-07ee-4bae-a743-febc29ee88ff None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.293627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.294422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.294815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.295198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.296150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:07.296582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:07.298947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:07.333500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 891/1781] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:54:07.336425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.356145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908358-1c38-4fd0-88e1-6bcd14db55cd None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.358258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.360240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.360778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.361606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.362614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:07.366065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:07.446775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.452272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:07.536013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 891/1782] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:07 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:07.541182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.724581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aece8-7a19-4a8b-a580-3751b0b53c37 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.731327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.732300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.732802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.733395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.734255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:07.748701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:07.758165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2da7-d863-471a-8b54-6e1a1b58f008 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.851134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 892/1783] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:07 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:07.852876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.887614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4afde4-c1c4-4a72-9209-553596b24429 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.887614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.887614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.887614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.888352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.888352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:07.888352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:07.903873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 893/1784] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:07.909196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.922790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d3bc-4e04-4cb5-b804-6a103fd34363 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.931527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.931527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.931527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.931527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.938635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9651c10-7752-4bb9-a2d5-7ec5608f5b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.940684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651c10-7752-4bb9-a2d5-7ec5608f5b10 service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.941085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651c10-7752-4bb9-a2d5-7ec5608f5b10 service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.941475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9651c10-7752-4bb9-a2d5-7ec5608f5b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.943154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:07.945045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:07.961410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 894/1785] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:07.963975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.999057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b59f8-50f6-4a87-8df7-d346ad3b14ab admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:08.017559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f998-db50-4e70-b3d5-96fd8cf8e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:08.020372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f998-db50-4e70-b3d5-96fd8cf8e915 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:08.020781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f998-db50-4e70-b3d5-96fd8cf8e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:08.021174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f998-db50-4e70-b3d5-96fd8cf8e915 admin admin] PATH_INFO: `/v3/projects/da6574a43e1145d18c23ebd42a9f63a4/users/356e69083f3342efb8090478c4d516f0/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:08.073314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f998-db50-4e70-b3d5-96fd8cf8e915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6574a43e1145d18c23ebd42a9f63a4, user_id=356e69083f3342efb8090478c4d516f0, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:08.083542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f998-db50-4e70-b3d5-96fd8cf8e915 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:08.083699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9651c10-7752-4bb9-a2d5-7ec5608f5b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:08.083699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9651c10-7752-4bb9-a2d5-7ec5608f5b10 service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:08.113503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:08.118291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 892/1786] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:54:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:54:08.210615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 895/1787] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:07 2022] PUT /identity/v3/projects/da6574a43e1145d18c23ebd42a9f63a4/users/356e69083f3342efb8090478c4d516f0/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:08.225566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:08.226805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:08.227100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:08.357212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:08.363228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] MFA Rules not processed for user `356e69083f3342efb8090478c4d516f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:08.366708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:08.368832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:08.369121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:08.369726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:08.412186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:08.413923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:08.647250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 893/1788] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:08.651062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:08.696848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 896/1789] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jul 25 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:08.768363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:08.770483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:08.792749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d5588-ae91-4280-924f-beceb77075bd None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:08.832316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:08.833419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:08.836491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:08.836980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:08.856082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:08.859002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:08.876082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 897/1790] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:08.999691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e4c19-18ac-4bec-93b3-cbc01a54feda None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:09.009068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:09.010868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:09.029685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:09.030656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:09.030656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:09.030849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:09.031969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:09.046349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:09.055240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa155-e892-469e-aa61-c7c2e8f37c4e service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:09.076277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:09.077062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:09.077254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:09.077542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] PATH_INFO: `/v3/users/3c3d96daf26c471385c6a8af76d5f51a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:09.091685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3d96daf26c471385c6a8af76d5f51a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:09.111602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:09.253452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 894/1791] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:08 2022] POST /identity/v3/projects => generated 385 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:09.257544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:09.451223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3d96daf26c471385c6a8af76d5f51a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:09.459644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3d96daf26c471385c6a8af76d5f51a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:09.485162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3d96daf26c471385c6a8af76d5f51a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:09.487080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3d96daf26c471385c6a8af76d5f51a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:09.513886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-18eb4c48-0806-4f56-85ac-e4f00d61ca9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3d96daf26c471385c6a8af76d5f51a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:09.537659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b7e34-82c0-49d9-8446-b69171ba2520 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:09.543902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:09.544831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:09.545423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:09.545967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:09.546901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:09.567805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:09.632175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 898/1792] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:09 2022] DELETE /identity/v3/users/3c3d96daf26c471385c6a8af76d5f51a => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:09.636894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:09.638953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:09.639497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:09.726372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 895/1793] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:09 2022] POST /identity/v3/users => generated 299 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:09.729969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:09.735653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:09.746597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:09.750343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:09.773539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c146541-4b04-4c28-8cdc-2c7669ff9dec admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:09.916345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:09.918477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:09.918477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:09.918477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:09.918477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:09.923861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:09.944602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 899/1794] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:09.951248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 896/1795] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:09.954043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:09.971681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799750c1-ce27-4766-a77d-8ddf9b403248 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:09.992013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:09.994503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:09.994882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:10.000897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] PATH_INFO: `/v3/projects/e6d4012b336a4fe18dd1e407fbfc2ede/users/e829abedfd05439d9013ee5f6d0ac23c/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:10.065173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d4012b336a4fe18dd1e407fbfc2ede, user_id=e829abedfd05439d9013ee5f6d0ac23c, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:10.080122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:10.081729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:10.090163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:10.251964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af65a8e-64cc-4d2c-99a9-8b7c41c165a2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:10.255866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:10.256761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:10.257161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:10.257389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:10.277210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:10.292055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:10.313311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 897/1796] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:10.421272 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 900/1797] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:09 2022] PUT /identity/v3/projects/e6d4012b336a4fe18dd1e407fbfc2ede/users/e829abedfd05439d9013ee5f6d0ac23c/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:10.428742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:10.443528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd23d-4089-40f6-8845-351176602412 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:10.545771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:10.617179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9b7a4-c042-438b-ba2e-723d6d0c4e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:10.620562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9b7a4-c042-438b-ba2e-723d6d0c4e28 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:10.621875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9b7a4-c042-438b-ba2e-723d6d0c4e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:10.623541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9b7a4-c042-438b-ba2e-723d6d0c4e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:10.628327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9b7a4-c042-438b-ba2e-723d6d0c4e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:10.631696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9b7a4-c042-438b-ba2e-723d6d0c4e28 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:10.660397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 898/1798] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:10.666520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:10.678601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739496dd-4dcc-4c17-879c-f9deae47bb93 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:10.712572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:10.713286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:10.713574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:10.713860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] PATH_INFO: `/v3/projects/e6d4012b336a4fe18dd1e407fbfc2ede/users/e829abedfd05439d9013ee5f6d0ac23c/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:10.716767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:10.725452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d4012b336a4fe18dd1e407fbfc2ede, user_id=e829abedfd05439d9013ee5f6d0ac23c, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:10.739787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:10.825761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 901/1799] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:10 2022] PUT /identity/v3/projects/e6d4012b336a4fe18dd1e407fbfc2ede/users/e829abedfd05439d9013ee5f6d0ac23c/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:10.828292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:10.829305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:10.830144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.026841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] MFA Rules not processed for user `e829abedfd05439d9013ee5f6d0ac23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:11.036746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:11.292782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 899/1800] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:11.318077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:11.321113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:11.643240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e6bd0-c57a-4a73-8a6c-f4a0722deeef admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:11.659162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:11.664749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:11.666293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:11.666985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:11.667870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.701950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:11.704728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:11.762541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 902/1801] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:11.854527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:11.856192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:11.972509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:12.089657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e4eb-3ce0-4ffc-9bf4-22d3c5f2731c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:12.096243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:12.101567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:12.101567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:12.101567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] PATH_INFO: `/v3/users/a4bc556fb6b24cd38b8175bc9adc6e12` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:12.101567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bc556fb6b24cd38b8175bc9adc6e12)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:12.101567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:12.137835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf227d9-03e4-41bd-9fa4-ed2464987de4 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:12.145369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:12.146314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:12.146758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:12.147194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] PATH_INFO: `/v3/users/356e69083f3342efb8090478c4d516f0` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:12.148833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356e69083f3342efb8090478c4d516f0)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:12.151168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:12.381830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bc556fb6b24cd38b8175bc9adc6e12'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.387285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bc556fb6b24cd38b8175bc9adc6e12'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.419677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:12.488568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356e69083f3342efb8090478c4d516f0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.490812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356e69083f3342efb8090478c4d516f0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.511498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356e69083f3342efb8090478c4d516f0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.511990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bc556fb6b24cd38b8175bc9adc6e12'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.512760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bc556fb6b24cd38b8175bc9adc6e12'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.516387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356e69083f3342efb8090478c4d516f0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.549206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b35bc8f2-fcbf-47e2-95be-e89c5275c3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356e69083f3342efb8090478c4d516f0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.570340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d3b96ffc-6660-4af9-8f95-5efb87d6d02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bc556fb6b24cd38b8175bc9adc6e12'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:12.602984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 900/1802] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:11 2022] DELETE /identity/v3/users/a4bc556fb6b24cd38b8175bc9adc6e12 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:12.605306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:12.611402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:12.611402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:12.639058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:12.641420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:12.697929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 903/1803] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:11 2022] DELETE /identity/v3/users/356e69083f3342efb8090478c4d516f0 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:12.707130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:12.709064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:12.726359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:12.805709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:12.809273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:12.944310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 901/1804] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:12.955862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:12.955862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:12.996445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6603d-c955-4cd4-a302-52ade84539b3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:13.044221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 904/1805] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:13.049313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:13.088411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:13.090718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:13.185181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:13.190638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.191226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.192250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] PATH_INFO: `/v3/projects/5de15f40eea54d88b3738d9ea29d8c74` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.195413 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de15f40eea54d88b3738d9ea29d8c74)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:13.201713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:13.373966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282f9f-3f61-4c07-911e-1799357c0792 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:13.397995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:13.399396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.401316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.403106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.430157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de15f40eea54d88b3738d9ea29d8c74', 'request_id': 'req-5da86992-9514-4af2-9923-705e16818c29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:13.455059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:13.457514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:13.507355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 905/1806] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:13.510398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:13.543872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf129-20ca-47ab-a2a9-e03f129be550 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:13.597516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de15f40eea54d88b3738d9ea29d8c74', 'request_id': 'req-5da86992-9514-4af2-9923-705e16818c29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:13.622704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de15f40eea54d88b3738d9ea29d8c74', 'request_id': 'req-5da86992-9514-4af2-9923-705e16818c29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:13.676012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] The token cache is being invalidate because project 5de15f40eea54d88b3738d9ea29d8c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:13.677964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:13.679941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5da86992-9514-4af2-9923-705e16818c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:13.694450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 902/1807] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:12 2022] DELETE /identity/v3/projects/5de15f40eea54d88b3738d9ea29d8c74 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:13.698339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d671ab-9a8c-4be3-942d-032b29a50208 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.698840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d671ab-9a8c-4be3-942d-032b29a50208 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.699336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d671ab-9a8c-4be3-942d-032b29a50208 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.706018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 903/1808] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:54:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:13.707508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d671ab-9a8c-4be3-942d-032b29a50208 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:13.752092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-89d671ab-9a8c-4be3-942d-032b29a50208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:13.817351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:13.819223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.819705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.827293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.834800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:13.991989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d671ab-9a8c-4be3-942d-032b29a50208 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:13.997441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:13.998359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.998840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.999304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] PATH_INFO: `/v3/users/25c91d0f534242e987cb44810d3b4569` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:14.000840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c91d0f534242e987cb44810d3b4569)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:14.003234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:14.024044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:14.026138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d359-53f2-463d-9915-8db7aa38bf88 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:14.042159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 906/1809] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:14.044520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:14.044952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:14.045383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:14.082916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:14.092495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:14.373307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 907/1810] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:54:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:14.411462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:14.417330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:14.488932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70214d71-7744-4e15-890f-f2ce226b8ebf None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:14.530712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:14.532395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:14.532773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:14.533108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:14.576473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:14.579046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:14.613590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 908/1811] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:14.701304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c91d0f534242e987cb44810d3b4569'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:14.702022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c91d0f534242e987cb44810d3b4569'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:14.961060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c91d0f534242e987cb44810d3b4569'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:14.961710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c91d0f534242e987cb44810d3b4569'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.001189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-83f3976b-7923-4af7-893c-7b7259665cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c91d0f534242e987cb44810d3b4569'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.047729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 904/1812] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:13 2022] DELETE /identity/v3/users/25c91d0f534242e987cb44810d3b4569 => generated 0 bytes in 1340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:15.240075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:15.259100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:15.265652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:15.327027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227af92-ad6a-47fa-9886-a60c6d4a4f36 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:15.478268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b94b-e0ba-4bc2-ad49-70308803b2be None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:15.478552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b94b-e0ba-4bc2-ad49-70308803b2be None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:15.480452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b94b-e0ba-4bc2-ad49-70308803b2be None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:15.482541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 905/1813] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:15.500965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:15.500965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:15.500965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:15.517537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] PATH_INFO: `/v3/projects/09cb86d470c64a4fb649c418a890f280` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:15.541633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cb86d470c64a4fb649c418a890f280)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:15.551518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:15.576424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:15.576662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:15.577960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:15.663962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:15.673395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:15.810308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cb86d470c64a4fb649c418a890f280', 'request_id': 'req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.820341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cb86d470c64a4fb649c418a890f280', 'request_id': 'req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.837988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cb86d470c64a4fb649c418a890f280', 'request_id': 'req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.876848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 906/1814] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:54:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:15.888033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:15.959873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] The token cache is being invalidate because project 09cb86d470c64a4fb649c418a890f280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:15.960154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.961098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:15.964507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 909/1815] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:15 2022] DELETE /identity/v3/projects/09cb86d470c64a4fb649c418a890f280 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:15.969936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:15.975044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:15.990023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d97d9f-6091-4088-b67c-5cb6a90c66ea None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:16.134980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:16.158670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:16.158670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:16.158670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] PATH_INFO: `/v3/users/b3bbe130721c4bbeabd02411683be275` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:16.158670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3bbe130721c4bbeabd02411683be275)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:16.158670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:16.566642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:16.572260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:16.690024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3bbe130721c4bbeabd02411683be275'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:16.690885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3bbe130721c4bbeabd02411683be275'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:16.778151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806fa9d-7565-4bd0-b5ad-8bd7286dc967 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:16.789271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:16.791777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:16.792671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:16.793847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:16.801155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:16.826824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3bbe130721c4bbeabd02411683be275'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:16.830195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3bbe130721c4bbeabd02411683be275'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:16.852503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:16.854497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:16.883989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3bbe130721c4bbeabd02411683be275'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:16.936813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 910/1816] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:16.966984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 907/1817] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:15 2022] DELETE /identity/v3/users/b3bbe130721c4bbeabd02411683be275 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:17.239916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:17.241281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:17.243710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:17.273420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ff9d-ca4e-45bb-9bd5-02f4dd9f22e5 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:17.505492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:17.507650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:17.507840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:17.516213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] PATH_INFO: `/v3/projects/da6574a43e1145d18c23ebd42a9f63a4` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:17.516213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6574a43e1145d18c23ebd42a9f63a4)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:17.516213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:17.666349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:17.686672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6574a43e1145d18c23ebd42a9f63a4', 'request_id': 'req-591cf8bd-1ed5-447a-94ef-93752a7ab793'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:17.697277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6574a43e1145d18c23ebd42a9f63a4', 'request_id': 'req-591cf8bd-1ed5-447a-94ef-93752a7ab793'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:17.709518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6574a43e1145d18c23ebd42a9f63a4', 'request_id': 'req-591cf8bd-1ed5-447a-94ef-93752a7ab793'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:17.819341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] The token cache is being invalidate because project da6574a43e1145d18c23ebd42a9f63a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:17.819969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:17.822958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:17.828295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:17.835304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 911/1818] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:17 2022] DELETE /identity/v3/projects/da6574a43e1145d18c23ebd42a9f63a4 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:17.840586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:17.850235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:17.897593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6de47-c906-42e4-b353-5a65e9e5d38e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:18.082374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:18.084252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:18.084801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:18.085312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] PATH_INFO: `/v3/users/e829abedfd05439d9013ee5f6d0ac23c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:18.094974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e829abedfd05439d9013ee5f6d0ac23c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:18.100998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:18.639070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e829abedfd05439d9013ee5f6d0ac23c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:18.639989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e829abedfd05439d9013ee5f6d0ac23c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:18.684745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:18.684745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:18.705643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf8bd-1ed5-447a-94ef-93752a7ab793 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:18.712809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:18.719555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:18.719555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:18.719555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] PATH_INFO: `/v3/projects/622da35a9167409099d832f5da23faa5` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:18.719555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=622da35a9167409099d832f5da23faa5)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:18.719555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:18.747026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e829abedfd05439d9013ee5f6d0ac23c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:18.747701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e829abedfd05439d9013ee5f6d0ac23c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:18.771744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8f9322d9-f3db-4c3c-84a5-770d11607cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e829abedfd05439d9013ee5f6d0ac23c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:18.805359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 908/1819] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:17 2022] DELETE /identity/v3/users/e829abedfd05439d9013ee5f6d0ac23c => generated 0 bytes in 965 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:18.969320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:19.012790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622da35a9167409099d832f5da23faa5', 'request_id': 'req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:19.033851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622da35a9167409099d832f5da23faa5', 'request_id': 'req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:19.073228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622da35a9167409099d832f5da23faa5', 'request_id': 'req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:19.196757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] The token cache is being invalidate because project 622da35a9167409099d832f5da23faa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:19.200827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:19.200827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-cf97eb48-3a1d-4cc7-8df7-5e34cc99aeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:19.203397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 912/1820] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:18 2022] DELETE /identity/v3/projects/622da35a9167409099d832f5da23faa5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:19.209294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:19.209773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:19.210152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:19.257980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:19.259261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:19.531842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 909/1821] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:19.537671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:19.538015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:19.538305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:19.600996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:19.602428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:19.644630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 913/1822] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:19.647647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:19.677475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa4466-e519-49b2-9300-89e108771b8d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:19.705180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:19.706490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:19.710039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:19.712143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:19.714533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:19.716043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:19.718351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:19.772029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 910/1823] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:54:19.774629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:19.793126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60703a8-0a90-4ef9-9f05-df984d411570 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:19.828502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:19.835226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:19.835719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:19.836283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:19.837215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:19.845285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:20.008660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 914/1824] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:19 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:20.009885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:20.038598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718feb8-855d-4961-8d40-772dcbdc1c37 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:20.214537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:20.216680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.217648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.218245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:20.220990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:20.223988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:20.375538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 911/1825] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:20 2022] POST /identity/v3/users => generated 285 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:20.380387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:20.394254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2af7f-d30e-4508-8f42-b888ae3065ed admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:20.408287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:20.409523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.410377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.410885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:20.412255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:20.415560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:20.432812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:20.434896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:20.461421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401e04-ca68-4778-aa4e-ddde05a261ee admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:20.467948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 915/1826] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:20.470302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:20.486143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ed631-0b91-43db-9080-cda664b375f0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:20.487361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:20.488409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.488702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.489009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] PATH_INFO: `/v3/projects/4638b5da18b54bc18e7ab191c4524ad4` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:20.492219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4638b5da18b54bc18e7ab191c4524ad4)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:20.494282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:20.495298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:20.496362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.497464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.498600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:20.499629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:20.503419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:20.522683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 916/1827] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:20.524210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:20.544099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e57ba-e878-4085-8a83-3d3297150432 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:20.550310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed24ee-d460-4129-ab3c-b232bea63ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:20.551158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed24ee-d460-4129-ab3c-b232bea63ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.552832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed24ee-d460-4129-ab3c-b232bea63ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.552832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed24ee-d460-4129-ab3c-b232bea63ed5 admin admin] PATH_INFO: `/v3/projects/820a615085834377bcb13eed9fe11cb2/users/0dc9cc89fb5144f7ba84ee1927a1e051/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:20.578023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed24ee-d460-4129-ab3c-b232bea63ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820a615085834377bcb13eed9fe11cb2, user_id=0dc9cc89fb5144f7ba84ee1927a1e051, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:20.614446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed24ee-d460-4129-ab3c-b232bea63ed5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:20.761864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 917/1828] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:20 2022] PUT /identity/v3/projects/820a615085834377bcb13eed9fe11cb2/users/0dc9cc89fb5144f7ba84ee1927a1e051/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:20.764301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.765024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.767645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:20.786924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4638b5da18b54bc18e7ab191c4524ad4', 'request_id': 'req-fc6a8d5b-2d72-480c-8f79-331400726e52'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:20.827222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] MFA Rules not processed for user `0dc9cc89fb5144f7ba84ee1927a1e051`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:20.829421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:20.900826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4638b5da18b54bc18e7ab191c4524ad4', 'request_id': 'req-fc6a8d5b-2d72-480c-8f79-331400726e52'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:20.912397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4638b5da18b54bc18e7ab191c4524ad4', 'request_id': 'req-fc6a8d5b-2d72-480c-8f79-331400726e52'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:20.928776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:20.950324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] The token cache is being invalidate because project 4638b5da18b54bc18e7ab191c4524ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:20.951172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:20.952257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc6a8d5b-2d72-480c-8f79-331400726e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:20.961432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 912/1829] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:20 2022] DELETE /identity/v3/projects/4638b5da18b54bc18e7ab191c4524ad4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:20.963144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc800a5-dd1f-4d76-88dc-0ce516fc6c6d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:20.963633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc800a5-dd1f-4d76-88dc-0ce516fc6c6d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:20.967615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc800a5-dd1f-4d76-88dc-0ce516fc6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.013225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-edc800a5-dd1f-4d76-88dc-0ce516fc6c6d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:21.015257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-edc800a5-dd1f-4d76-88dc-0ce516fc6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.067490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 918/1830] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:21.085189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.087646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.188980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c1191-7279-4b7c-ad4e-720f582ba44c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:21.193527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82172225-2e0a-4967-b918-97179472097c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:21.194443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82172225-2e0a-4967-b918-97179472097c service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.194837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82172225-2e0a-4967-b918-97179472097c service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.195222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82172225-2e0a-4967-b918-97179472097c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.206734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82172225-2e0a-4967-b918-97179472097c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:21.208832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82172225-2e0a-4967-b918-97179472097c service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:21.209282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:21.246452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 919/1831] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:21.247712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82172225-2e0a-4967-b918-97179472097c service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.249564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-82172225-2e0a-4967-b918-97179472097c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.263807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 913/1832] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:21.271065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.271357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.271632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.274227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82172225-2e0a-4967-b918-97179472097c service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:21.293762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:21.294718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.295023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.295366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] PATH_INFO: `/v3/users/0dc9cc89fb5144f7ba84ee1927a1e051` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.297399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc9cc89fb5144f7ba84ee1927a1e051)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:21.300254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:21.345461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:21.352019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.380420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 914/1833] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:21.384887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.411637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf02b3-8c07-4e83-a49b-d97efcd1aba0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:21.417014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:21.424684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.425411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.431084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.433206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:21.437237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:21.447092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:21.492343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 915/1834] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:54:21.516500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.566181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a6d3a-c249-447e-9ada-2b053733d861 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:21.580342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc9cc89fb5144f7ba84ee1927a1e051'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:21.581432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc9cc89fb5144f7ba84ee1927a1e051'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:21.586325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:21.591229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.592222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.593791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.598877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:21.602459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:21.629777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc9cc89fb5144f7ba84ee1927a1e051'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:21.633682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc9cc89fb5144f7ba84ee1927a1e051'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:21.694304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc9cc89fb5144f7ba84ee1927a1e051'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:21.784924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 916/1835] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:21 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:21.810186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.829038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 920/1836] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:21 2022] DELETE /identity/v3/users/0dc9cc89fb5144f7ba84ee1927a1e051 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:21.833289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.835286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.842194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.979709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:22.014414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858d9b4-3337-4ad3-9cf9-072538204c38 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:22.025206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252169da-dc95-4c15-bd5d-2a36271ce400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:22.025870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252169da-dc95-4c15-bd5d-2a36271ce400 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:22.026164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252169da-dc95-4c15-bd5d-2a36271ce400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:22.026449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252169da-dc95-4c15-bd5d-2a36271ce400 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:22.027157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252169da-dc95-4c15-bd5d-2a36271ce400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:22.029226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252169da-dc95-4c15-bd5d-2a36271ce400 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:22.045196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324a279-4d67-44b5-b923-f87512ef3d1b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:22.052366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:22.053794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:22.054538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:22.055097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] PATH_INFO: `/v3/projects/e6d4012b336a4fe18dd1e407fbfc2ede` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:22.056990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d4012b336a4fe18dd1e407fbfc2ede)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:22.059801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:22.172935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 921/1837] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:21 2022] POST /identity/v3/users => generated 291 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:22.172935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988243-8251-43be-a810-7caa563534e9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:22.172935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988243-8251-43be-a810-7caa563534e9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:22.172935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988243-8251-43be-a810-7caa563534e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:22.259531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-44988243-8251-43be-a810-7caa563534e9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:22.261992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-44988243-8251-43be-a810-7caa563534e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:22.311492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 922/1838] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:22.317999 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988243-8251-43be-a810-7caa563534e9 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:22.354042 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988243-8251-43be-a810-7caa563534e9 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:22.374445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:22.375721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:22.376072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:22.376412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:22.377174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:22.381563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:22.405916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 923/1839] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:22.409170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:22.411601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:22.597584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d4012b336a4fe18dd1e407fbfc2ede', 'request_id': 'req-2f8d01d8-93d2-4e40-80cb-f99c70368f17'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:22.630935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038f02-7ac1-4bcf-8b21-2ff61789d655 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:22.716496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d4012b336a4fe18dd1e407fbfc2ede', 'request_id': 'req-2f8d01d8-93d2-4e40-80cb-f99c70368f17'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:22.729173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d4012b336a4fe18dd1e407fbfc2ede', 'request_id': 'req-2f8d01d8-93d2-4e40-80cb-f99c70368f17'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:22.769555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] The token cache is being invalidate because project e6d4012b336a4fe18dd1e407fbfc2ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:22.769555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:22.771936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:22.777995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 917/1840] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:21 2022] DELETE /identity/v3/projects/e6d4012b336a4fe18dd1e407fbfc2ede => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:22.780740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:22.784237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:22.786604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:22.787495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:22.788861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:22.789145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:22.793483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:22.962103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d01d8-93d2-4e40-80cb-f99c70368f17 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:22.967093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:22.979935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:22.980914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:22.982081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:22.982824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:22.985508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:22.989632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:22.991887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:22.997696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d5331-08ca-49d9-b592-adb56f043b2c service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.006992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 924/1841] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:23.008331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3dce-14b8-475c-b81e-b6880b127562 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.008843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3dce-14b8-475c-b81e-b6880b127562 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.009321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3dce-14b8-475c-b81e-b6880b127562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.021781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 918/1842] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:23.022672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.036035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-cafb3dce-14b8-475c-b81e-b6880b127562 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:23.038470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cafb3dce-14b8-475c-b81e-b6880b127562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:23.047573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f72569-3f42-4350-92f1-cad725c7367f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.056063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 925/1843] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:23.059229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0849-f034-4250-97bc-96e0bb8fe228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.060195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0849-f034-4250-97bc-96e0bb8fe228 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.060705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0849-f034-4250-97bc-96e0bb8fe228 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.061704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0849-f034-4250-97bc-96e0bb8fe228 admin admin] PATH_INFO: `/v3/projects/8cccee4aab1b4a8dbb0c634a89328d9e/users/f11d6c452fe940edbe80c831f497f77f/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.067148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.067446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.068409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.082845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0849-f034-4250-97bc-96e0bb8fe228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cccee4aab1b4a8dbb0c634a89328d9e, user_id=f11d6c452fe940edbe80c831f497f77f, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.086278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0849-f034-4250-97bc-96e0bb8fe228 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.091627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:23.093050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:23.103069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 926/1844] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:23.107329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.118085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fe95a-e810-4a86-aa70-0233c2c6795a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.124238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.125500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.125863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.126386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.127020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:23.127499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.136575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.147818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 927/1845] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:54:23.150012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.168695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0455-4d87-464f-8f05-0fcf125599c4 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.175641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.176434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.176719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.176995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.177676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.179658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.222686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 919/1846] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:23 2022] PUT /identity/v3/projects/8cccee4aab1b4a8dbb0c634a89328d9e/users/f11d6c452fe940edbe80c831f497f77f/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:23.231473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.232075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.232430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.263595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] MFA Rules not processed for user `f11d6c452fe940edbe80c831f497f77f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:23.268763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:23.320736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 928/1847] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:23.329246 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.429894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 920/1848] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:23.438686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.500224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f6967-71c0-48bb-94e7-c7b617f0092d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.512252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.516293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.516293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.516293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.518392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.519482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.575202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9fd14-b6f4-497a-aa2f-15fd6fe9ef08 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.582514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.583458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.583884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.584278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.585160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.587721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.638616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 929/1849] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:23.641968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.658247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec0ac-d698-4ada-950d-892eb5464cc6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.665725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.666799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.667451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.668040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.670475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.674140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.688301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 930/1850] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:23.696598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 921/1851] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:23.698461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.699421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.738980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55dc6d-425a-411f-9cb3-efb39ec99e20 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.838266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3d8cf-98f4-4cec-8332-54dcffa97e40 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.841622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.842421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.842717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.842996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.844385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.845937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.846148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.846916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.847356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.847974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.849131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.851434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.857490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 931/1852] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:23.868023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.874178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589686-38dd-42dd-9d0e-be5c9e4983e4 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.880027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.880885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.881434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.881721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] PATH_INFO: `/v3/projects/767f75ec74554de6b1044d7b2084c10e/users/c4c9e8d9603e45498aec44f63e3dbca8/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.909293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=767f75ec74554de6b1044d7b2084c10e, user_id=c4c9e8d9603e45498aec44f63e3dbca8, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.912357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.965910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 922/1853] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:23.967339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.973662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:23.989404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 932/1854] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:23 2022] PUT /identity/v3/projects/767f75ec74554de6b1044d7b2084c10e/users/c4c9e8d9603e45498aec44f63e3dbca8/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:23.989404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.014987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19893f2-b26f-409c-b61a-f2068b000660 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.091075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9413da-363c-4a65-bb39-fa1f8cc059fe admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.096800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615b3be-3e15-46ed-b70f-6267e486a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.098255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b3be-3e15-46ed-b70f-6267e486a21f admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.098255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b3be-3e15-46ed-b70f-6267e486a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.098607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b3be-3e15-46ed-b70f-6267e486a21f admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.099559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615b3be-3e15-46ed-b70f-6267e486a21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.101443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615b3be-3e15-46ed-b70f-6267e486a21f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.117968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 933/1855] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:24.119387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.119693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.120073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.123388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.127637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.127637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.127637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] PATH_INFO: `/v3/projects/820a615085834377bcb13eed9fe11cb2` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.127637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=820a615085834377bcb13eed9fe11cb2)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.132874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.144015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:24.145429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.154250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 934/1856] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:24.155149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.165378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bcecb-3bd4-4e31-bdc6-ecbfe5fcf61b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.171469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.172788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.173078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.173362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] PATH_INFO: `/v3/projects/4fafcd7843ec4c589029233cea007802/users/63b4679c9ff8450483e4fe34008ce17a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.189570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fafcd7843ec4c589029233cea007802, user_id=63b4679c9ff8450483e4fe34008ce17a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.192304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.263016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 935/1857] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:24 2022] PUT /identity/v3/projects/4fafcd7843ec4c589029233cea007802/users/63b4679c9ff8450483e4fe34008ce17a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:24.263016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.263016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.289114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820a615085834377bcb13eed9fe11cb2', 'request_id': 'req-fbc5c12e-c006-44ae-9218-d904fde0b11d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:24.330242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052fbe5-9827-4bdb-a1f1-b66f3c76078c admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.351403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820a615085834377bcb13eed9fe11cb2', 'request_id': 'req-fbc5c12e-c006-44ae-9218-d904fde0b11d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:24.360852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820a615085834377bcb13eed9fe11cb2', 'request_id': 'req-fbc5c12e-c006-44ae-9218-d904fde0b11d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:24.375908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] The token cache is being invalidate because project 820a615085834377bcb13eed9fe11cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:24.376194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:24.376904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:24.378969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 923/1858] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:23 2022] DELETE /identity/v3/projects/820a615085834377bcb13eed9fe11cb2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:24.383924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.385905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.390462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.401045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.401045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.401045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.401045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.464514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c12e-c006-44ae-9218-d904fde0b11d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.470302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30732039-e04e-4b18-b791-05e11a01c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.470943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30732039-e04e-4b18-b791-05e11a01c883 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.471233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30732039-e04e-4b18-b791-05e11a01c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.471519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30732039-e04e-4b18-b791-05e11a01c883 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.472726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30732039-e04e-4b18-b791-05e11a01c883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.474572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30732039-e04e-4b18-b791-05e11a01c883 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.476622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.478776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.486696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 924/1859] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:24.490493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868f78-8efc-4ab2-93d9-5017c24f376d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.490493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868f78-8efc-4ab2-93d9-5017c24f376d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.490493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868f78-8efc-4ab2-93d9-5017c24f376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.493382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 936/1860] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:24.493751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.505521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5ff4-d957-464f-becf-88d4cf7dd24c service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.513367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d5ce-0b29-4ade-8c7e-9d5dc0919b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.514591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5ce-0b29-4ade-8c7e-9d5dc0919b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.515029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5ce-0b29-4ade-8c7e-9d5dc0919b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.515942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5ce-0b29-4ade-8c7e-9d5dc0919b26 admin admin] PATH_INFO: `/v3/projects/4fafcd7843ec4c589029233cea007802/users/63b4679c9ff8450483e4fe34008ce17a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.518434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d5ce-0b29-4ade-8c7e-9d5dc0919b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fafcd7843ec4c589029233cea007802, user_id=63b4679c9ff8450483e4fe34008ce17a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.521862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d5ce-0b29-4ade-8c7e-9d5dc0919b26 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.534216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 937/1861] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:24 2022] PUT /identity/v3/projects/4fafcd7843ec4c589029233cea007802/users/63b4679c9ff8450483e4fe34008ce17a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:24.538129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1f868f78-8efc-4ab2-93d9-5017c24f376d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:24.538129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1f868f78-8efc-4ab2-93d9-5017c24f376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.547566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.547892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.548170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.582530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] MFA Rules not processed for user `63b4679c9ff8450483e4fe34008ce17a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:24.584379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.613281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 925/1862] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:24.613281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.613281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.613281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.633623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:24.636392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.648097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 926/1863] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:24.649454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.659656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6abe7-482f-40f3-a906-6bc75bb38bfc None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.665058 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.665760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.666420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.666586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.667321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:24.667706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.669503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.672745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 938/1864] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:24.683664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 927/1865] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:54:24.691033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.691631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.692660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:24.724754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db240-fdfe-415a-b326-fcd87af34923 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.738662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.739556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.739682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.739900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.740600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.742661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.769402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f84bc-3e70-4871-b430-f1195ee81bc4 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.774366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.775246 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.775595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.776003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.791503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.796763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:24.804307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 939/1866] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:24.885552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 928/1867] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:24 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:54:24.889599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:24.910097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679de4f-0572-4de3-878e-30a426fa0ca6 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:24.962683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:24.973133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:24.973773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:24.974066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:24.974346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:24.975032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:24.977176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.010778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.082249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b48630-6037-496f-84b1-51bb2b70aefd admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.084031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 940/1868] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:24 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:25.090586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.091634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.092350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.092635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.092914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.095618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:25.099608 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59cc09-eb0a-47f7-855b-a3b805c7871a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.104935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.105688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.106061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.106432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.107210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.109017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.121911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 941/1869] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:25.126686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.150252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3f59-81e0-4343-b759-1c41ffcf20d7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.157307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.158137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.158519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.158908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.159799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.161569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.174744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 942/1870] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:54:25.178723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.191953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43437a22-ed4e-41c4-8ab9-8dd757de57ca admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.193582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.195380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1a7ed-851e-47cc-bf55-e5555a614ab7 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.198713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.208745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 929/1871] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:25.216662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.216662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.216662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] PATH_INFO: `/v3/projects/89ca83342235440c9295ff3a272a6d88/users/b57a5fdbef5e4607a69a5c51c3c3a547/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.258286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ca83342235440c9295ff3a272a6d88, user_id=b57a5fdbef5e4607a69a5c51c3c3a547, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.261361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.378416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 943/1872] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:25 2022] PUT /identity/v3/projects/89ca83342235440c9295ff3a272a6d88/users/b57a5fdbef5e4607a69a5c51c3c3a547/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:25.397710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.398397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.398793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.450574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] MFA Rules not processed for user `b57a5fdbef5e4607a69a5c51c3c3a547`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:25.452978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:25.556802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:25.568904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 930/1873] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:25.573511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.649630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682756a-134d-4bbd-8c3d-c63df5a78bd0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.654492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.655131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.655421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.655698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.657002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.661076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.770563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 944/1874] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:25 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:25.772049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.783802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b928e-7bb7-40e9-82d6-e37707af49a0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.844590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.850276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.850276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.850276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.850276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.850276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:25.876702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:25.887791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd113-7967-4759-80b5-5ea323399c7f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:25.893289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:25.893933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:25.894218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:25.894496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] PATH_INFO: `/v3/users/f11d6c452fe940edbe80c831f497f77f` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:25.895674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11d6c452fe940edbe80c831f497f77f)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:25.897819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:26.000682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 931/1875] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:25 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:26.004757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.017753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a306-b5b8-4d12-8d0b-ebb65b1ea7a8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:26.023065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:26.023989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.024283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.024562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.025282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:26.026918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:26.042128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 932/1876] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:54:26.045326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.057918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd666c-9a4f-4bd7-9705-bc8de68bb600 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:26.063200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccefd3-78ea-4974-8a89-3ce823831633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:26.063924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccefd3-78ea-4974-8a89-3ce823831633 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.064225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccefd3-78ea-4974-8a89-3ce823831633 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.064512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccefd3-78ea-4974-8a89-3ce823831633 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.065239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccefd3-78ea-4974-8a89-3ce823831633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:26.066845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccefd3-78ea-4974-8a89-3ce823831633 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:26.096835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 933/1877] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:26.100284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.100585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.100913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.135586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] MFA Rules not processed for user `c4c9e8d9603e45498aec44f63e3dbca8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:26.137175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.145047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11d6c452fe940edbe80c831f497f77f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:26.145811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11d6c452fe940edbe80c831f497f77f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:26.153599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11d6c452fe940edbe80c831f497f77f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:26.155475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11d6c452fe940edbe80c831f497f77f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:26.181919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11d6c452fe940edbe80c831f497f77f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:26.244253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 934/1878] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:26.245473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.247188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.257801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 945/1879] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:25 2022] DELETE /identity/v3/users/f11d6c452fe940edbe80c831f497f77f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:26.259449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.263654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.267033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5bca-4683-4b06-8eda-c631df092ea4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:26.411658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cc4f9-9ca5-4fcf-9fc3-0563417aefcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:26.411658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc4f9-9ca5-4fcf-9fc3-0563417aefcc admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.411658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc4f9-9ca5-4fcf-9fc3-0563417aefcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.411658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cc4f9-9ca5-4fcf-9fc3-0563417aefcc admin admin] PATH_INFO: `/v3/projects/f85dbc047f634215a21535502d869c19/users/46ee655a719e44acbdc81c1403b4d4c9/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.466001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1691de-4635-4de1-b429-46d065830763 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:26.468187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc4f9-9ca5-4fcf-9fc3-0563417aefcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85dbc047f634215a21535502d869c19, user_id=46ee655a719e44acbdc81c1403b4d4c9, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:26.479742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110f915-8d0a-4d93-a9a9-87a05bdccfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:26.480645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110f915-8d0a-4d93-a9a9-87a05bdccfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.481090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110f915-8d0a-4d93-a9a9-87a05bdccfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.482064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110f915-8d0a-4d93-a9a9-87a05bdccfa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.485664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110f915-8d0a-4d93-a9a9-87a05bdccfa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:26.486534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cc4f9-9ca5-4fcf-9fc3-0563417aefcc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:26.488570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110f915-8d0a-4d93-a9a9-87a05bdccfa0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:26.619036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 935/1880] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:26 2022] PUT /identity/v3/projects/f85dbc047f634215a21535502d869c19/users/46ee655a719e44acbdc81c1403b4d4c9/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:26.623424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.623424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.623424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.636750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 946/1881] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:26 2022] POST /identity/v3/projects => generated 371 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:26.640476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.642426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.644961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.691348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:26.694675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.719885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] MFA Rules not processed for user `46ee655a719e44acbdc81c1403b4d4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:26.722905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.873780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 936/1882] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:26.874464 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.900099 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 947/1883] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:26.900349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307392-08b6-41f5-bce8-68a441dab61e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:26.900504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.904184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.909261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:26.910979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.911875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.912447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.913920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:26.917951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.005687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6721d2-8062-47ab-abe9-58e260b630b7 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.009874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.010513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.011452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.011452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.025437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.026108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.040318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 948/1884] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:27.041288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.056192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b337f6c-af78-48a3-a1ec-cd27900b5f2a service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.062990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.064462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.064765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.065048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.065890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.066124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 937/1885] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:26 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:27.068192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.069677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.104530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2abb-15bb-4be1-b677-b80a1e1df23b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.114443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.116025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.116652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.117783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.118857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.122167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.146527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 938/1886] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:27.162482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.167573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 949/1887] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:27 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:27.168686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.216859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff8117-8f8d-4e03-a12f-a99c234f99f1 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.220190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:27.386862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140587-9bbf-4ca1-ba71-ba1bcecacae5 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.399580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.400767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.401212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.402088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.403492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.406406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.409677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.415879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.415879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.415879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] PATH_INFO: `/v3/projects/502ccbcb55b84a478870c5a1d4721367/users/6d11e661cc694ebebb835836cd7fdbf2/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.430754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502ccbcb55b84a478870c5a1d4721367, user_id=6d11e661cc694ebebb835836cd7fdbf2, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.434100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.511267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 950/1888] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:27 2022] POST /identity/v3/users => generated 295 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:27.512520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.533259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a82075-1d64-40c7-b178-273cbd835b6e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.540266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.540993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.541455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.541822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.542617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.545005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.572207 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 939/1889] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:27 2022] PUT /identity/v3/projects/502ccbcb55b84a478870c5a1d4721367/users/6d11e661cc694ebebb835836cd7fdbf2/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:27.578617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 951/1890] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:27.578835 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.581035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.594179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda60d8-bbcb-4a88-88eb-449f51028234 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.656784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:27.692680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.694435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.694945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.695483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] PATH_INFO: `/v3/projects/b0e620566bdc42f5bd6d6b373fe7f128/users/a43dca41cb3944e08ec54e93e1feb151/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.714790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4fbd-7b98-4cbc-b8de-a03d6bcac2c9 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.716582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e620566bdc42f5bd6d6b373fe7f128, user_id=a43dca41cb3944e08ec54e93e1feb151, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.721483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.724527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.725113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.725230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.729665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.729665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.729665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.743539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 940/1891] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:27.744776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.755604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829177-3798-4291-8be8-5941dd7e429f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.760795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:27.761417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:27.761708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:27.762022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] PATH_INFO: `/v3/projects/502ccbcb55b84a478870c5a1d4721367/users/6d11e661cc694ebebb835836cd7fdbf2/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:27.764092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502ccbcb55b84a478870c5a1d4721367, user_id=6d11e661cc694ebebb835836cd7fdbf2, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:27.767566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:27.778886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 941/1892] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:27 2022] PUT /identity/v3/projects/502ccbcb55b84a478870c5a1d4721367/users/6d11e661cc694ebebb835836cd7fdbf2/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:27.825287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 952/1893] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:27 2022] PUT /identity/v3/projects/b0e620566bdc42f5bd6d6b373fe7f128/users/a43dca41cb3944e08ec54e93e1feb151/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:27.827469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.915597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7cf7-7739-4e15-9a9b-78348435aa11 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:27.983278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:27.985498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:28.036539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:28.037410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:28.038280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:28.038714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:28.040103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:28.043020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:28.049637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:28.059865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 942/1894] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:28.063143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:28.094241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe0f5-eff7-4590-9289-cddb39b702f5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:28.110139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aad7b3-2246-4a86-aa17-aa6b2a53ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:28.117394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad7b3-2246-4a86-aa17-aa6b2a53ae8d admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:28.117394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad7b3-2246-4a86-aa17-aa6b2a53ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:28.117394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad7b3-2246-4a86-aa17-aa6b2a53ae8d admin admin] PATH_INFO: `/v3/projects/b0e620566bdc42f5bd6d6b373fe7f128/users/a43dca41cb3944e08ec54e93e1feb151/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:28.117394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aad7b3-2246-4a86-aa17-aa6b2a53ae8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e620566bdc42f5bd6d6b373fe7f128, user_id=a43dca41cb3944e08ec54e93e1feb151, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:28.118553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aad7b3-2246-4a86-aa17-aa6b2a53ae8d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:28.123661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc01512-927c-49e5-bab0-d0ed60b851c3 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:28.132327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:28.133908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 943/1895] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:28 2022] PUT /identity/v3/projects/b0e620566bdc42f5bd6d6b373fe7f128/users/a43dca41cb3944e08ec54e93e1feb151/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:28.143923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:28.144582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:28.145087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] PATH_INFO: `/v3/projects/8cccee4aab1b4a8dbb0c634a89328d9e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:28.145600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:28.146164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:28.146677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:28.147623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cccee4aab1b4a8dbb0c634a89328d9e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:28.150844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:28.191647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] MFA Rules not processed for user `a43dca41cb3944e08ec54e93e1feb151`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:28.193756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:28.372003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 944/1896] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:28.381515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cccee4aab1b4a8dbb0c634a89328d9e', 'request_id': 'req-8e9bfcdf-8df2-46df-b905-f616d60102a9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:28.385828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:28.387938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:28.391388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cccee4aab1b4a8dbb0c634a89328d9e', 'request_id': 'req-8e9bfcdf-8df2-46df-b905-f616d60102a9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:28.400434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cccee4aab1b4a8dbb0c634a89328d9e', 'request_id': 'req-8e9bfcdf-8df2-46df-b905-f616d60102a9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:28.479044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b9ef-8599-4833-90d2-d8648e4af206 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:28.501721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] The token cache is being invalidate because project 8cccee4aab1b4a8dbb0c634a89328d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:28.501971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:28.502789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:28.508286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 953/1897] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:27 2022] DELETE /identity/v3/projects/8cccee4aab1b4a8dbb0c634a89328d9e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:28.509578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:28.511264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:28.573547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:28.574704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:28.575408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:28.575892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:28.580304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:28.670963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:28.683933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bfcdf-8df2-46df-b905-f616d60102a9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:28.687539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:28.688870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:28.689449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:28.690012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] PATH_INFO: `/v3/users/63b4679c9ff8450483e4fe34008ce17a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:28.691503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b4679c9ff8450483e4fe34008ce17a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:28.693665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:28.702336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:28.708469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072364a-a3b9-4f3f-972e-e21753a4fde3 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:28.729220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 945/1898] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:29.041303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b4679c9ff8450483e4fe34008ce17a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:29.041990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b4679c9ff8450483e4fe34008ce17a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:29.050559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b4679c9ff8450483e4fe34008ce17a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:29.051358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b4679c9ff8450483e4fe34008ce17a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:29.088810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b4679c9ff8450483e4fe34008ce17a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:29.238117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 954/1899] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:28 2022] DELETE /identity/v3/users/63b4679c9ff8450483e4fe34008ce17a => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:29.885450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffa126-f41f-4952-8269-81dee5553981 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:29.887169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffa126-f41f-4952-8269-81dee5553981 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:29.887994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffa126-f41f-4952-8269-81dee5553981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:29.929483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a8ffa126-f41f-4952-8269-81dee5553981 None None] MFA Rules not processed for user `6d11e661cc694ebebb835836cd7fdbf2`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:29.935913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a8ffa126-f41f-4952-8269-81dee5553981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.055915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:30.056450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 946/1900] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:30.056535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.060928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.061558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.063093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.119330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] MFA Rules not processed for user `c4c9e8d9603e45498aec44f63e3dbca8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:30.120628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.180484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb112841-e55d-41fa-a455-8aad63706b5b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:30.191513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:30.193132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.193631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.194595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] PATH_INFO: `/v3/projects/4fafcd7843ec4c589029233cea007802` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.196929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fafcd7843ec4c589029233cea007802)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:30.200071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:30.219674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 947/1901] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:30.242031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:30.242031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.326454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601887f0-d719-4fd8-97a8-90828535ea63 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:30.334073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:30.335041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.335479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.339310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.339310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.350179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fafcd7843ec4c589029233cea007802', 'request_id': 'req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:30.353682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:30.355535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9ca45-9d9e-4252-aea5-a03c5bcafa91 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:30.357047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fafcd7843ec4c589029233cea007802', 'request_id': 'req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:30.367591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fafcd7843ec4c589029233cea007802', 'request_id': 'req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:30.372064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 948/1902] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:30.503472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] The token cache is being invalidate because project 4fafcd7843ec4c589029233cea007802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:30.504388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:30.505933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3d0e5ab0-6ea9-4986-9b7a-eca7846757ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:30.507958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 955/1903] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:30 2022] DELETE /identity/v3/projects/4fafcd7843ec4c589029233cea007802 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:30.512781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.513077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.513357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.538210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:30.540292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.607106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:30.633357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 949/1904] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:30.642354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.642644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.642995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.685159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:30.686480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:30.711530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 956/1905] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:30.715575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:30.726001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8c59e-97db-4849-bc9e-4588b965ab82 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:30.732467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:30.737632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.738031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.738386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.739703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:30.740754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:30.743923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571982-f80b-4525-bf65-17b82a52e393 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:30.762873 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 950/1906] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:54:30.764294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:30.787458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fe9ad-5dd8-468c-940c-e5bf4f59dc86 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:30.799133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:30.800642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.812660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.813161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.815653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:30.828344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:30.930177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9077227-5dca-4147-a514-8269baff5a19 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.930714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9077227-5dca-4147-a514-8269baff5a19 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.931084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9077227-5dca-4147-a514-8269baff5a19 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.933753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 951/1907] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:54:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:54:30.953491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:30.953825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:30.954115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:30.972610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 957/1908] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:30 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:54:30.973982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.004933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:31.006558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:31.107620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfba71b-7b22-4fa9-9113-48ff8e201422 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:31.115398 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 952/1909] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:54:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:31.116824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:31.117724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.118216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.118716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.119620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:31.121971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:31.174702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.179488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:31.229600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 958/1910] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:30 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:31.231944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.236325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:31.274118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceef3e-3ee9-4389-bcb1-31ce8e13e5a7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:31.294465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:31.297449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.297449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.297449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.310331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:31.312721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:31.338544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca0f37-11a3-417a-b6fa-44d6e5c40ea9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:31.339865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 959/1911] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:31.340116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:31.340116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.340116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.340116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.340434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:31.345049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.379788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2986f-b324-4015-9850-3a27a9e1f78f service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:31.395093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:31.404981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.405586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.408865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.409731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:31.416096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:31.438805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 960/1912] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:31.440570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.442043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:31.443728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:31.456191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 953/1913] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:31.477650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844205c-bf88-41a4-822e-c42ec76a2f47 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:31.488918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50733e-7cab-445b-b223-a365ad534442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:31.489897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50733e-7cab-445b-b223-a365ad534442 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.490348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50733e-7cab-445b-b223-a365ad534442 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.490632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50733e-7cab-445b-b223-a365ad534442 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.491346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50733e-7cab-445b-b223-a365ad534442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:31.493027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50733e-7cab-445b-b223-a365ad534442 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:31.523193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 961/1914] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:31.525104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.546818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a1fc0-e0cf-4813-9916-219edf353984 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:31.567536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:31.568553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.571208 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.571208 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] PATH_INFO: `/v3/projects/2ef37abd084945eaaed93dc7d9766a60/users/740bc1e042394a74bdb964af59734277/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.599860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef37abd084945eaaed93dc7d9766a60, user_id=740bc1e042394a74bdb964af59734277, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:31.602510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:31.710977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 954/1915] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:31 2022] PUT /identity/v3/projects/2ef37abd084945eaaed93dc7d9766a60/users/740bc1e042394a74bdb964af59734277/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:31.719530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:31.719867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:31.720146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:31.758354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] MFA Rules not processed for user `740bc1e042394a74bdb964af59734277`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:31.760280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:31.799514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:31.890176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 962/1916] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:31.903778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:31.905784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:32.001279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49532b-1837-4640-8e30-c87dbf8c3fa9 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:32.005202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:32.005834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:32.006123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:32.006657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:32.015811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:32.017370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:32.026638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 955/1917] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:33.402030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:33.412103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6d805-9e8d-49ea-bfe1-d34a894f5535 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:33.415991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:33.416558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:33.416869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:33.417148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:33.419111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:33.497497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:33.498990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed6b0e-07ea-4d88-b508-5f011a9ea4ad service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:33.511935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 963/1918] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:33.540252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:34.694081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:36.263732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:36.731684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:36.852297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2930e1-6a7b-4d6b-8d96-72b852b92031 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:36.857159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:36.857828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:36.858119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:36.858421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] PATH_INFO: `/v3/users/740bc1e042394a74bdb964af59734277` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:36.859639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] RBAC: Authorizing `identity:delete_user(user_id=740bc1e042394a74bdb964af59734277)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:36.861750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:37.249053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740bc1e042394a74bdb964af59734277'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:37.250853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740bc1e042394a74bdb964af59734277'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:37.322960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:37.349325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740bc1e042394a74bdb964af59734277'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:37.350498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740bc1e042394a74bdb964af59734277'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:37.377537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740bc1e042394a74bdb964af59734277'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:37.402264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 956/1919] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:36 2022] DELETE /identity/v3/users/740bc1e042394a74bdb964af59734277 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:37.410354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:37.410922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:37.410922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:37.443210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:37.444491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:37.534538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 964/1920] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:37.545577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:37.547350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:37.644803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf7d30-a191-484c-a947-6b5980f2905f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:37.655954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:37.657752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:37.658334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:37.658910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:37.678495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:37.682879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:37.708165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 957/1921] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:38.261573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:38.266849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:38.309941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39bac-e728-4ea2-9aab-0130a49f9c59 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:38.319071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:38.319844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.320137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.320412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] PATH_INFO: `/v3/projects/2ef37abd084945eaaed93dc7d9766a60` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.322563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef37abd084945eaaed93dc7d9766a60)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:38.324631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:38.514654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef37abd084945eaaed93dc7d9766a60', 'request_id': 'req-4a13152e-cf6a-4e20-93c7-78315b638edd'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:38.523679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef37abd084945eaaed93dc7d9766a60', 'request_id': 'req-4a13152e-cf6a-4e20-93c7-78315b638edd'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:38.534475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef37abd084945eaaed93dc7d9766a60', 'request_id': 'req-4a13152e-cf6a-4e20-93c7-78315b638edd'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:38.547637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:38.550577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:38.568053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c43e-1b9a-49db-9cf0-553676fcf488 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:38.649288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] The token cache is being invalidate because project 2ef37abd084945eaaed93dc7d9766a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:38.652378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:38.654915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4a13152e-cf6a-4e20-93c7-78315b638edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:38.660650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 965/1922] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:38 2022] DELETE /identity/v3/projects/2ef37abd084945eaaed93dc7d9766a60 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:38.661833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:38.663905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.664555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.665210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] PATH_INFO: `/v3/users/b57a5fdbef5e4607a69a5c51c3c3a547` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.666711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7cc20-08e1-4a76-b7a1-e22985fe2b39 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.667770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57a5fdbef5e4607a69a5c51c3c3a547)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:38.668627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7cc20-08e1-4a76-b7a1-e22985fe2b39 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.669338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7cc20-08e1-4a76-b7a1-e22985fe2b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.677452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:38.718929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a9a7cc20-08e1-4a76-b7a1-e22985fe2b39 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:38.720846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a9a7cc20-08e1-4a76-b7a1-e22985fe2b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:38.744662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 966/1923] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:38.755084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.755084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.756708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.797252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:38.816714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:38.819399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:38.832583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 967/1924] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:38.836696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:38.850541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c3b6e-95e3-44e6-8f70-4ec2e2415f13 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:38.856434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:38.857312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.857731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.858134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.859029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:38.859444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:38.861482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:38.881827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 968/1925] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:54:38.887218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:38.899467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79149b-afaa-403c-a4eb-cf7d5b1219c9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:38.905396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:38.907420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.908017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.908529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.909497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:38.911715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:38.923092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:39.011381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57a5fdbef5e4607a69a5c51c3c3a547'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:39.012218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57a5fdbef5e4607a69a5c51c3c3a547'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:39.038806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 969/1926] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:38 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:39.040982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:39.122279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57a5fdbef5e4607a69a5c51c3c3a547'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:39.123162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57a5fdbef5e4607a69a5c51c3c3a547'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:39.138690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f152ef-be8a-4be4-addd-f2edbf1e7d3c admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:39.143332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e066255f-aba6-46a8-b97a-3c189b318277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57a5fdbef5e4607a69a5c51c3c3a547'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:39.146280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:39.147108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.147588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.148230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.149074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:39.152080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:39.163009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 958/1927] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:38 2022] DELETE /identity/v3/users/b57a5fdbef5e4607a69a5c51c3c3a547 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:39.165952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.166361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.166840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.194914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:39.196302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:39.290835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 970/1928] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:39 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:39.299930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:39.305691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 959/1929] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:39.308581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:39.320761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:39.322865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:39.325136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf6b1a-2430-4c44-a487-e43d721cabbc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:39.331432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:39.332404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.332773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.333145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.333946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:39.336001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:39.356721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 971/1930] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:39.366745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:39.385469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdb595-967a-4ecd-ad11-166b3836fd75 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:39.395465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:39.395741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.396128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.396502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.397724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:39.400484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:39.419344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 972/1931] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:54:39.421228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:39.429483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93d159-c7c8-45e8-a916-73df5d1cbe03 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:39.436462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86825af7-d5d9-4eaa-ae0c-b9b7d6fa1ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:39.438211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86825af7-d5d9-4eaa-ae0c-b9b7d6fa1ade service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.438330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1486-521d-439a-bfc4-6b96123deb93 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:39.438794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86825af7-d5d9-4eaa-ae0c-b9b7d6fa1ade service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.439222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86825af7-d5d9-4eaa-ae0c-b9b7d6fa1ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.448471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:39.449754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.450454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.451080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] PATH_INFO: `/v3/projects/6dc5585d88fc4db2abb4619f8a77ca17/users/3a131713842d4508ba7a7b9aaddd23af/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.457392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86825af7-d5d9-4eaa-ae0c-b9b7d6fa1ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:39.459911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86825af7-d5d9-4eaa-ae0c-b9b7d6fa1ade service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:39.476740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 960/1932] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:39.500662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc5585d88fc4db2abb4619f8a77ca17, user_id=3a131713842d4508ba7a7b9aaddd23af, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:39.503677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:39.581568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 973/1933] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:39 2022] PUT /identity/v3/projects/6dc5585d88fc4db2abb4619f8a77ca17/users/3a131713842d4508ba7a7b9aaddd23af/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:39.586761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.587225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.587589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.608304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:39.610716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:39.687300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 961/1934] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:39.700629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:39.703136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:39.831686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05388b-98fc-4124-a681-e02d2526747b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:39.836382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:39.837187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:39.837779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:39.838196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:39.850675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:39.852443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:39.865673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 974/1935] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:40.168577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:40.403122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:40.406443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:40.458645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ebbf-f383-40c3-a50b-2e6901cadb92 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:40.465619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:40.470226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:40.470226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:40.470226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] PATH_INFO: `/v3/projects/89ca83342235440c9295ff3a272a6d88` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:40.470226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ca83342235440c9295ff3a272a6d88)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:40.480659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:40.684650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ca83342235440c9295ff3a272a6d88', 'request_id': 'req-5aedac95-e2bc-47f6-a416-2564b16cc5d2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:40.784081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ca83342235440c9295ff3a272a6d88', 'request_id': 'req-5aedac95-e2bc-47f6-a416-2564b16cc5d2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:40.796635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ca83342235440c9295ff3a272a6d88', 'request_id': 'req-5aedac95-e2bc-47f6-a416-2564b16cc5d2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:40.815402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] The token cache is being invalidate because project 89ca83342235440c9295ff3a272a6d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:40.816487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:40.817454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5aedac95-e2bc-47f6-a416-2564b16cc5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:40.823556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 962/1936] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:40 2022] DELETE /identity/v3/projects/89ca83342235440c9295ff3a272a6d88 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:40.824962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:40.855386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f5a0-74fd-46c5-a7c6-1420ac09c4b1 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:40.973637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:40.974308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:40.974967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:40.975327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] PATH_INFO: `/v3/users/46ee655a719e44acbdc81c1403b4d4c9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:40.976993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ee655a719e44acbdc81c1403b4d4c9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:40.979141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:41.209096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:41.225315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ee655a719e44acbdc81c1403b4d4c9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:41.226136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ee655a719e44acbdc81c1403b4d4c9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:41.233736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ee655a719e44acbdc81c1403b4d4c9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:41.235381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ee655a719e44acbdc81c1403b4d4c9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:41.247742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ee655a719e44acbdc81c1403b4d4c9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:41.319338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 975/1937] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:40 2022] DELETE /identity/v3/users/46ee655a719e44acbdc81c1403b4d4c9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:41.912990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:41.913455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:41.913746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:41.928315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:41.970967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] MFA Rules not processed for user `3a131713842d4508ba7a7b9aaddd23af`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:41.972431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:42.019575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:42.024880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:42.105501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 963/1938] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:42.116701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:42.120206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:42.198429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba74f-7241-4aad-832b-96fe1422c12a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:42.209533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:42.211224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:42.212043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:42.215001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] PATH_INFO: `/v3/projects/f85dbc047f634215a21535502d869c19` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:42.218147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85dbc047f634215a21535502d869c19)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:42.225017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:42.244629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2995f-3f5c-4bcd-8613-ef78edbaa64f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:42.264648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:42.264648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:42.264648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:42.264648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:42.274737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:42.278761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:42.296179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 964/1939] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:42.397915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85dbc047f634215a21535502d869c19', 'request_id': 'req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:42.407616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85dbc047f634215a21535502d869c19', 'request_id': 'req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:42.415704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85dbc047f634215a21535502d869c19', 'request_id': 'req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:42.513492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] The token cache is being invalidate because project f85dbc047f634215a21535502d869c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:42.513795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:42.515409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:42.518267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 976/1940] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:42 2022] DELETE /identity/v3/projects/f85dbc047f634215a21535502d869c19 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:54:42.522356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:42.535782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e2f73-94a8-4c46-9985-510d200dd465 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:42.620321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:42.621492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:42.621787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:42.622074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] PATH_INFO: `/v3/users/a43dca41cb3944e08ec54e93e1feb151` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:42.625285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43dca41cb3944e08ec54e93e1feb151)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:42.627306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:42.917198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:42.962454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43dca41cb3944e08ec54e93e1feb151'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:42.963243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43dca41cb3944e08ec54e93e1feb151'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:43.070971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43dca41cb3944e08ec54e93e1feb151'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:43.071667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43dca41cb3944e08ec54e93e1feb151'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:43.096098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a69eb290-4ac9-4612-b547-bf21535018a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43dca41cb3944e08ec54e93e1feb151'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:43.123951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 965/1941] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:42 2022] DELETE /identity/v3/users/a43dca41cb3944e08ec54e93e1feb151 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:43.866223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:43.868066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:43.885026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93ecb-a3d0-4319-82d0-9b80a10fbb53 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:43.955459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:43.956067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:43.956355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:43.956632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] PATH_INFO: `/v3/projects/b0e620566bdc42f5bd6d6b373fe7f128` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:43.957820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e620566bdc42f5bd6d6b373fe7f128)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:43.959732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:44.020040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:44.105715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e620566bdc42f5bd6d6b373fe7f128', 'request_id': 'req-e3645105-e8f2-45b0-830e-bbae32d86542'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:44.118345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e620566bdc42f5bd6d6b373fe7f128', 'request_id': 'req-e3645105-e8f2-45b0-830e-bbae32d86542'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:44.127978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e620566bdc42f5bd6d6b373fe7f128', 'request_id': 'req-e3645105-e8f2-45b0-830e-bbae32d86542'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:44.254119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] The token cache is being invalidate because project b0e620566bdc42f5bd6d6b373fe7f128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:44.254609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:44.255953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e3645105-e8f2-45b0-830e-bbae32d86542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:44.259235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 977/1942] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:43 2022] DELETE /identity/v3/projects/b0e620566bdc42f5bd6d6b373fe7f128 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:44.264890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acc6b-d609-4e43-b81b-e83d9a09fc35 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:44.266458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acc6b-d609-4e43-b81b-e83d9a09fc35 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:44.267078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acc6b-d609-4e43-b81b-e83d9a09fc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:44.321950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-693acc6b-d609-4e43-b81b-e83d9a09fc35 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:44.323311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-693acc6b-d609-4e43-b81b-e83d9a09fc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:44.432805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:44.433106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:44.433398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:44.443060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 966/1943] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:44.452599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:44.453243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:44.453601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:44.461000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] MFA Rules not processed for user `3a131713842d4508ba7a7b9aaddd23af`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:44.462542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:44.488474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:44.494425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:44.516029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 967/1944] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:44.520985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:44.533998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4fff6-c203-447e-aacc-6e8b9263ce10 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:44.536002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 978/1945] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:44.543573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:44.544384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:44.545519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:44.545886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:44.548063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:54:44.549070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:44.550811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:44.570884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 968/1946] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:54:44.578249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:44.598591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dddce-411e-4f4f-9137-1890f7e2fcd9 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:44.605353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:44.605720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:44.607631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:44.607631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:44.607631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:44.610787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:44.742765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 979/1947] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:54:44 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:44.743106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:44.757000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ac5d7-2ea0-4b1b-a841-2939f387216e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:44.904236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:44.907733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:44.908381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:44.909209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:44.910479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:44.913361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:45.018059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 969/1948] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:54:44 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:54:45.018787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:45.030621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8c40-42d9-4efe-b4ad-0f6f647fb3bf admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:45.037319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:45.038068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:45.038364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:45.038819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:45.039547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:45.041252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:45.055668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 980/1949] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:45.059791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:45.079704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534eed0-6303-4711-86b6-e9467f210db0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:45.090138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:45.101712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d591877-508c-4c75-87d0-7124e6315d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:45.102588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d591877-508c-4c75-87d0-7124e6315d41 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:45.103042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d591877-508c-4c75-87d0-7124e6315d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:45.103486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d591877-508c-4c75-87d0-7124e6315d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:45.105638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d591877-508c-4c75-87d0-7124e6315d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:45.112906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d591877-508c-4c75-87d0-7124e6315d41 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:45.148435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 970/1950] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:45.151368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:45.171519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20db37-4789-4537-9d54-f27896ad44f7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:45.187117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:45.188273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:45.188785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:45.189282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] PATH_INFO: `/v3/projects/4d00b591055840948628fddd252af02b/users/f11c09d170694e4fba335af9e881b322/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:45.248029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d00b591055840948628fddd252af02b, user_id=f11c09d170694e4fba335af9e881b322, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:45.251641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:45.371504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 981/1951] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:54:45 2022] PUT /identity/v3/projects/4d00b591055840948628fddd252af02b/users/f11c09d170694e4fba335af9e881b322/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:45.375384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:45.377892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:45.378431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:45.481825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] MFA Rules not processed for user `f11c09d170694e4fba335af9e881b322`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:45.483164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:45.598062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 971/1952] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:45.616405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:45.618412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:45.726956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13b23c-3f4e-4805-9c57-11741e4b4844 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:45.731395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:45.732385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:45.732679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:45.732958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:45.744530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:45.747319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:45.775094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:45.775889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 982/1953] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:47.043729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:48.492448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:48.581302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:49.562863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:49.591012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:50.256566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:50.989674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:51.439662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:52.517714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:52.681204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:52.688306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:52.711750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e972e-674a-467a-b35b-6214e43b19a0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:52.718020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:52.719253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:52.719696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:52.720211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:52.722529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:52.896803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:52.899978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9d5c8-2cd1-4ee9-9ff1-a40b11897b40 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:52.926582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 972/1954] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:54.045425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:54.515921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:55.773694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:56.525274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:56.869538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:57.142605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:57.144357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:57.272713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ac295-bd9f-49c0-8c36-13870bbbeeed service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:57.288014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:57.288891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:57.289325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:57.289771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] PATH_INFO: `/v3/users/3bac1ba7c72c40d7aea3bfd3048a8d1e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:57.292687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bac1ba7c72c40d7aea3bfd3048a8d1e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:57.294996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:57.424972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:57.494566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bac1ba7c72c40d7aea3bfd3048a8d1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:57.495274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bac1ba7c72c40d7aea3bfd3048a8d1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:57.504865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bac1ba7c72c40d7aea3bfd3048a8d1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:57.506565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bac1ba7c72c40d7aea3bfd3048a8d1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:57.522936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bac1ba7c72c40d7aea3bfd3048a8d1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:57.534670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:57.575223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 983/1955] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:57 2022] DELETE /identity/v3/users/3bac1ba7c72c40d7aea3bfd3048a8d1e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:57.580781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:57.581601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:57.581601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:57.610283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:57.611676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:57.680638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 973/1956] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:57.718627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:57.722441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:57.830420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d319-80e4-4edc-9ff7-e03105fe3ce7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:57.843941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:57.843941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:57.843941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:57.843941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:57.869694 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:57.871650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:57.892116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 984/1957] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:58.706658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:58.709661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:58.737674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5df751-2e7f-471e-9507-9c25b070494a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:58.745991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:58.746804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:58.747289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:58.753970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] PATH_INFO: `/v3/projects/669224039f294696b89ec0e0ab995406` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:58.756583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669224039f294696b89ec0e0ab995406)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:58.759314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:58.994229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669224039f294696b89ec0e0ab995406', 'request_id': 'req-e74017e5-9779-492e-9e19-666b32cece00'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.080532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669224039f294696b89ec0e0ab995406', 'request_id': 'req-e74017e5-9779-492e-9e19-666b32cece00'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.088864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669224039f294696b89ec0e0ab995406', 'request_id': 'req-e74017e5-9779-492e-9e19-666b32cece00'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.112267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] The token cache is being invalidate because project 669224039f294696b89ec0e0ab995406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:54:59.112857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.113597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.116256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 974/1958] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:54:58 2022] DELETE /identity/v3/projects/669224039f294696b89ec0e0ab995406 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:59.120019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:59.134647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d94ced-a9e8-43ac-a44a-fa3373df31be service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:59.210679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:59.211453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:59.217428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:59.221509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] PATH_INFO: `/v3/users/a463c4e9cbf945399acf432051a67ca1` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:59.221509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a463c4e9cbf945399acf432051a67ca1)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:59.224129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:59.448582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:59.467019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a463c4e9cbf945399acf432051a67ca1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.467717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a463c4e9cbf945399acf432051a67ca1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.493468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a463c4e9cbf945399acf432051a67ca1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.494483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a463c4e9cbf945399acf432051a67ca1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.518300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-95a58c4d-f2c9-4f79-85fb-7b4672b7c60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a463c4e9cbf945399acf432051a67ca1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:54:59.630965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 985/1959] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:59 2022] DELETE /identity/v3/users/a463c4e9cbf945399acf432051a67ca1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:54:59.687839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:59.742737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:59.744280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:59.757880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74017e5-9779-492e-9e19-666b32cece00 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:59.830005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:59.832228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:59.832845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:59.833433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] PATH_INFO: `/v3/users/f11c09d170694e4fba335af9e881b322` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:59.836006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11c09d170694e4fba335af9e881b322)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:59.839077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:59.896093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322a5ef-3251-4544-9577-671b521dd839 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:59.896544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322a5ef-3251-4544-9577-671b521dd839 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:59.896988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322a5ef-3251-4544-9577-671b521dd839 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:59.898542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 986/1960] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:59.926388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:59.926676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:59.926957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:59.948860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:59.950255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.016413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 987/1961] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:54:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:00.027464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.031206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.042635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bbb4b-a21b-4243-92d1-dbafefea8178 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.048906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.049575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.049868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.050152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.059528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.061260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.073504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 988/1962] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:00.074434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.076075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.088922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11c09d170694e4fba335af9e881b322'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.090201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11c09d170694e4fba335af9e881b322'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.092548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148b146-f4d5-4f2b-a171-b081c8e18e84 service placement] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.098256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.098925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.099216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.099499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] PATH_INFO: `/v3/users/9e9955f5ee3c4ff7884b2492ea16d3c0` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.100823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9955f5ee3c4ff7884b2492ea16d3c0)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.102841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.179369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11c09d170694e4fba335af9e881b322'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.180072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11c09d170694e4fba335af9e881b322'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.192676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11c09d170694e4fba335af9e881b322'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.207443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 975/1963] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:54:59 2022] DELETE /identity/v3/users/f11c09d170694e4fba335af9e881b322 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:00.208860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.209730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.273791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a97a-3ea7-461f-9335-e0ec733108bc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.278647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.279430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.279721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.280027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] PATH_INFO: `/v3/projects/921a9c55273f48e9a0a66f66eb63857f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.281906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] RBAC: Authorizing `identity:delete_project(project_id=921a9c55273f48e9a0a66f66eb63857f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.283930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.312747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9955f5ee3c4ff7884b2492ea16d3c0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.314153 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9955f5ee3c4ff7884b2492ea16d3c0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.321861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9955f5ee3c4ff7884b2492ea16d3c0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.325048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9955f5ee3c4ff7884b2492ea16d3c0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.336872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-23e9606c-fe6c-4189-9ecb-dc64a9f1026b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9955f5ee3c4ff7884b2492ea16d3c0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.420654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 989/1964] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:00 2022] DELETE /identity/v3/users/9e9955f5ee3c4ff7884b2492ea16d3c0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:00.422277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.422795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.423235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.444755 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921a9c55273f48e9a0a66f66eb63857f', 'request_id': 'req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.446032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:00.447431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.516830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921a9c55273f48e9a0a66f66eb63857f', 'request_id': 'req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.521253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 990/1965] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:00.525259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921a9c55273f48e9a0a66f66eb63857f', 'request_id': 'req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.540384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] The token cache is being invalidate because project 921a9c55273f48e9a0a66f66eb63857f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:00.541089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.541995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c4aaf280-fd87-4b96-afd8-3b95fdb8977c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:00.542117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.548146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 976/1966] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:00 2022] DELETE /identity/v3/projects/921a9c55273f48e9a0a66f66eb63857f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:00.548696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.552038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30297d7-b781-40ad-b356-8112704bb126 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.552038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30297d7-b781-40ad-b356-8112704bb126 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.552038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30297d7-b781-40ad-b356-8112704bb126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.575003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a30297d7-b781-40ad-b356-8112704bb126 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:00.576301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a30297d7-b781-40ad-b356-8112704bb126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.586747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 977/1967] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:00.597060 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.598192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.598651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.621080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:00.622327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.626553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc974-6448-4222-aa99-edd9b3cf417c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.630859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.631814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.632054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.632343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 978/1968] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:00.632471 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.639738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.642586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.648098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.649630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.661823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8e94-e0b3-4358-a0ff-dbc587bce69e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.669706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.670681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.671622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.671992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.672768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:00.673177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.675093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.675968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 991/1969] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:00.691898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 979/1970] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:55:00.697050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.708174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc001-5e63-417d-9841-ac97027d9c3b service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.713580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.714025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.714307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.714592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.715297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.717413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.757564 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.760498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:00.775946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818dea-de05-4f6a-a335-45c5c40ea4c1 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.782234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.783261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.784000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.784449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] PATH_INFO: `/v3/projects/ba8f475902014cb383f6f8d387ffdb79` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.786970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8f475902014cb383f6f8d387ffdb79)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.789140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.811171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 992/1971] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:00 2022] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:00.815410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:00.830960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:00.897689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f8080-5b80-4d55-ab77-feafe1672a1e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:00.898244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:00.898886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:00.899178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:00.899462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:00.900393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:00.902667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:00.943861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8f475902014cb383f6f8d387ffdb79', 'request_id': 'req-91bf7045-6aef-40b7-9ffa-d586e8012d18'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.051936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8f475902014cb383f6f8d387ffdb79', 'request_id': 'req-91bf7045-6aef-40b7-9ffa-d586e8012d18'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.058045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 993/1972] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:00 2022] POST /identity/v3/users => generated 279 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:01.059516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.065677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8f475902014cb383f6f8d387ffdb79', 'request_id': 'req-91bf7045-6aef-40b7-9ffa-d586e8012d18'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.071244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f92a-7aa9-4560-ba63-aa730841c08d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.097051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] The token cache is being invalidate because project ba8f475902014cb383f6f8d387ffdb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:01.097486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.098271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-91bf7045-6aef-40b7-9ffa-d586e8012d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.100202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 980/1973] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:00 2022] DELETE /identity/v3/projects/ba8f475902014cb383f6f8d387ffdb79 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:01.104793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.105141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.105488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.128044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:01.129617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.142449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.143250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.143675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.144116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.144935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.146647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.157034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 994/1974] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:01.161167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.163521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.176220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0630ddc-4c61-4ee9-a53a-7e49d0cc6632 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.181319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c689a6-0e10-41ab-8108-00244c867c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.181945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c689a6-0e10-41ab-8108-00244c867c56 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.182279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c689a6-0e10-41ab-8108-00244c867c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.182572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c689a6-0e10-41ab-8108-00244c867c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.183353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c689a6-0e10-41ab-8108-00244c867c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.184993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c689a6-0e10-41ab-8108-00244c867c56 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.193721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 981/1975] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:01.199671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 995/1976] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:01.201667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.203073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.203449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.203823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.212932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1950-5ee6-486e-a174-59773d3d80df None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.219477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.220415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.220695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.220967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] PATH_INFO: `/v3/projects/aa434339a4e34864b3d55d1d8b6d3f82/users/6900c0cfa86a489b9be5aa533054cf8f/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.237811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:01.239056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa434339a4e34864b3d55d1d8b6d3f82, user_id=6900c0cfa86a489b9be5aa533054cf8f, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.239185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.241903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.248499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 996/1977] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:01.249866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.251357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.264103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fae2a-50a2-461a-ae04-2da4e57af336 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.269934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.270646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.271090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.271375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] PATH_INFO: `/v3/projects/4d00b591055840948628fddd252af02b` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.272641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d00b591055840948628fddd252af02b)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.274702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.291488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 982/1978] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:01 2022] PUT /identity/v3/projects/aa434339a4e34864b3d55d1d8b6d3f82/users/6900c0cfa86a489b9be5aa533054cf8f/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:01.302728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.367386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b329a-f6bb-4059-b0f3-f1ed5b961f4a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.372552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.373185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.374699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.374699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.375265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:01.375568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.377543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646291-c4c3-4e65-a26d-45edf8959e97 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.385737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d00b591055840948628fddd252af02b', 'request_id': 'req-090b846b-988c-4a49-9a5e-6fa4084ded87'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.390493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 983/1979] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:55:01.391870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.392195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.392441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.392914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d00b591055840948628fddd252af02b', 'request_id': 'req-090b846b-988c-4a49-9a5e-6fa4084ded87'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.399059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d00b591055840948628fddd252af02b', 'request_id': 'req-090b846b-988c-4a49-9a5e-6fa4084ded87'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.421420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] MFA Rules not processed for user `6900c0cfa86a489b9be5aa533054cf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:01.422718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.468843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] The token cache is being invalidate because project 4d00b591055840948628fddd252af02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:01.469150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.469849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:01.471431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 997/1980] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:01 2022] DELETE /identity/v3/projects/4d00b591055840948628fddd252af02b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:01.472383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.474235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.512635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 984/1981] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:01.518129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.520188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:01.575872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b846b-988c-4a49-9a5e-6fa4084ded87 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.596755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.597417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.597702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.598003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.598783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.600982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.640549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d818e3a-6c8c-4b98-b9d4-829b8a7f74bf None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.645728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.646519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.646724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.647006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.648022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.651995 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.729848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 998/1982] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/projects => generated 389 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:01.735561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.758239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 985/1983] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/projects => generated 355 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:01.764143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.781163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:01.806553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11405f-6fe3-4f8d-acde-c7dc213862a7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.841103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2b90-0f85-48f8-9e5e-cec23836b2a6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.846957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.847589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.847922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.848244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.848963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.850912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.891353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.892052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.892318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.892657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.893351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.895427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.963775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 986/1984] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:01.967582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:01.978823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3999df-457c-4b51-969e-88efdd61ef41 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:01.986696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:01.988541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:01.989495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:01.989495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:01.990390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:01.991976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:01.992548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 999/1985] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:01 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:01.996530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.008833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 987/1986] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:02.012418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ea06c-d366-4524-9c6a-4e3738e7e013 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.017597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.018844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.018844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.019044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.019328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.020026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.021801 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.038593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efffac-18d9-46d3-883a-25908d093f36 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.038593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.038826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1000/1987] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:02.038916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.038916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.039095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] PATH_INFO: `/v3/projects/e519865c7e0f44e8a06b25e986f80284/users/e1c7348b62d34f8d98cb514f548fd4a8/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.039892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.051003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e623-856a-41ce-8ba6-4d9b56c69711 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.055996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.056654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.056941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.057248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.058150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.059800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.063057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e519865c7e0f44e8a06b25e986f80284, user_id=e1c7348b62d34f8d98cb514f548fd4a8, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.065787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.072321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1001/1988] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:02.081848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.095138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f420569-9bef-484f-8f5c-26f70792e986 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.099909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7596ad-3679-4240-bad2-2bb201006c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.100601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7596ad-3679-4240-bad2-2bb201006c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.100884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7596ad-3679-4240-bad2-2bb201006c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.101314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7596ad-3679-4240-bad2-2bb201006c70 admin admin] PATH_INFO: `/v3/projects/44e119a573cb4a6fa330382d12c96080/users/b59a8ab5cdfd4dbabe6fb7c871f543e6/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.117645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7596ad-3679-4240-bad2-2bb201006c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e119a573cb4a6fa330382d12c96080, user_id=b59a8ab5cdfd4dbabe6fb7c871f543e6, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.120396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7596ad-3679-4240-bad2-2bb201006c70 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.145753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 988/1989] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:02 2022] PUT /identity/v3/projects/e519865c7e0f44e8a06b25e986f80284/users/e1c7348b62d34f8d98cb514f548fd4a8/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:02.149700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.174317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1002/1990] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:02 2022] PUT /identity/v3/projects/44e119a573cb4a6fa330382d12c96080/users/b59a8ab5cdfd4dbabe6fb7c871f543e6/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:02.179389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.179683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.180016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.201163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:02.202934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.217578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66606a12-d081-451f-983b-d63d3095457d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.282811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1003/1991] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:02.289845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.291888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.312410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.313048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.313333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.313613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.314355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.316032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.329120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 989/1992] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:02.333877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.351133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac62cda-a8c5-4c55-8e81-4fe65ea2bb7a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.359494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a679b2a-e703-45d6-b5e8-c2249ddca73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.360694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679b2a-e703-45d6-b5e8-c2249ddca73b admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.361133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679b2a-e703-45d6-b5e8-c2249ddca73b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.361528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a679b2a-e703-45d6-b5e8-c2249ddca73b admin admin] PATH_INFO: `/v3/projects/e519865c7e0f44e8a06b25e986f80284/users/e1c7348b62d34f8d98cb514f548fd4a8/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.364121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679b2a-e703-45d6-b5e8-c2249ddca73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e519865c7e0f44e8a06b25e986f80284, user_id=e1c7348b62d34f8d98cb514f548fd4a8, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.367017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a679b2a-e703-45d6-b5e8-c2249ddca73b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.374867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0379d2-227a-4ddd-a633-8ff54bca18e3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.378767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 990/1993] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:02 2022] PUT /identity/v3/projects/e519865c7e0f44e8a06b25e986f80284/users/e1c7348b62d34f8d98cb514f548fd4a8/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:02.391426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.391721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.392046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.426900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] MFA Rules not processed for user `e1c7348b62d34f8d98cb514f548fd4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:02.428277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.428760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.428913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.429201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.429480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.493308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.494900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.505335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 991/1994] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:02 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:02.506992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1004/1995] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:02.517809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.519411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:02.584611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60168399-aeaf-4c70-99d2-0b4d7cf24acf None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.588656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e44d3-9cd4-42bf-99df-45e681a1aece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.589279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e44d3-9cd4-42bf-99df-45e681a1aece service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.589564 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e44d3-9cd4-42bf-99df-45e681a1aece service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.589840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e44d3-9cd4-42bf-99df-45e681a1aece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.600377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e44d3-9cd4-42bf-99df-45e681a1aece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.601837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e44d3-9cd4-42bf-99df-45e681a1aece service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:02.613343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 992/1996] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:02 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:02.671084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:02.901361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:02.914001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75cd4e-888a-43c6-bc77-6450d1a48fd4 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:02.927130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578e2d1-bf55-4fa1-9650-6ef8b8dda626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:02.928611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e2d1-bf55-4fa1-9650-6ef8b8dda626 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:02.928904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e2d1-bf55-4fa1-9650-6ef8b8dda626 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:02.929187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e2d1-bf55-4fa1-9650-6ef8b8dda626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:02.997090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e2d1-bf55-4fa1-9650-6ef8b8dda626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:02.998438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e2d1-bf55-4fa1-9650-6ef8b8dda626 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:03.008465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1005/1997] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:03.517521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:04.539790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:05.077242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:05.802415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:06.292287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:06.903728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:07.789820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:08.589587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:08.590418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:08.590945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:08.618397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] MFA Rules not processed for user `3a131713842d4508ba7a7b9aaddd23af`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:08.619949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:08.707824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 993/1998] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:09.413453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd84e5-8647-4ee0-9277-28fedd785abf None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:09.414764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd84e5-8647-4ee0-9277-28fedd785abf None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:09.415378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd84e5-8647-4ee0-9277-28fedd785abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:09.466126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-cebd84e5-8647-4ee0-9277-28fedd785abf None None] MFA Rules not processed for user `b59a8ab5cdfd4dbabe6fb7c871f543e6`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:09.468688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cebd84e5-8647-4ee0-9277-28fedd785abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:09.612874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1006/1999] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:09.628516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:09.630039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:09.736510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f2f56-f80b-4e45-9667-253eea3f9810 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:09.742806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:09.743845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:09.744382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:09.744880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:09.754712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:09.756933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:09.772896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 994/2000] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:10.737457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:12.567177 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:12.787545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:12.787815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:12.788043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:12.840585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] MFA Rules not processed for user `b59a8ab5cdfd4dbabe6fb7c871f543e6`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:12.843561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:12.852817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1007/2001] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:19.763668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:22.147043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:22.148631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:22.165077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac832-0aa6-44ac-bd15-3c46ec2b7962 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:22.169702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:22.170355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:22.171337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:22.171671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] PATH_INFO: `/v3/users/c4c9e8d9603e45498aec44f63e3dbca8` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:22.172980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c9e8d9603e45498aec44f63e3dbca8)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:22.174914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:22.413430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c9e8d9603e45498aec44f63e3dbca8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:22.415343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c9e8d9603e45498aec44f63e3dbca8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:22.502711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c9e8d9603e45498aec44f63e3dbca8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:22.503387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c9e8d9603e45498aec44f63e3dbca8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:22.520662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c9e8d9603e45498aec44f63e3dbca8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:22.535050 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 995/2002] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:22 2022] DELETE /identity/v3/users/c4c9e8d9603e45498aec44f63e3dbca8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:22.883651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:22.900069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a642bbf-1afc-4019-8d9e-d7b38bd06601 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:23.001200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:23.002200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:23.002200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:23.002482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] PATH_INFO: `/v3/projects/767f75ec74554de6b1044d7b2084c10e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:23.003728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767f75ec74554de6b1044d7b2084c10e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:23.006353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:23.166036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767f75ec74554de6b1044d7b2084c10e', 'request_id': 'req-dda134b7-3340-4fdd-81c1-36b8644b0c11'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.175298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767f75ec74554de6b1044d7b2084c10e', 'request_id': 'req-dda134b7-3340-4fdd-81c1-36b8644b0c11'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.184379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767f75ec74554de6b1044d7b2084c10e', 'request_id': 'req-dda134b7-3340-4fdd-81c1-36b8644b0c11'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.307103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] The token cache is being invalidate because project 767f75ec74554de6b1044d7b2084c10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:23.307405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.308119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.309661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1008/2003] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:22 2022] DELETE /identity/v3/projects/767f75ec74554de6b1044d7b2084c10e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:23.314642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:23.316061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:23.329438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95d37-c332-44b9-8c8b-3e62d0530cc3 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:23.391831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:23.392524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:23.392810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:23.393092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] PATH_INFO: `/v3/users/6d11e661cc694ebebb835836cd7fdbf2` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:23.394344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d11e661cc694ebebb835836cd7fdbf2)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:23.396494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:23.674898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d11e661cc694ebebb835836cd7fdbf2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.675586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d11e661cc694ebebb835836cd7fdbf2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.751084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d11e661cc694ebebb835836cd7fdbf2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.751708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d11e661cc694ebebb835836cd7fdbf2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.765244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-af0e0c27-d978-472f-8a5f-1fc4e31b5282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d11e661cc694ebebb835836cd7fdbf2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:23.767365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:23.778542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 996/2004] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:23 2022] DELETE /identity/v3/users/6d11e661cc694ebebb835836cd7fdbf2 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:24.111257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:24.113527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:24.152410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda134b7-3340-4fdd-81c1-36b8644b0c11 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:24.206736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:24.230807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:24.274398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:24.274398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:24.274398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] PATH_INFO: `/v3/projects/502ccbcb55b84a478870c5a1d4721367` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:24.274398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502ccbcb55b84a478870c5a1d4721367)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:24.274398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:24.557089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502ccbcb55b84a478870c5a1d4721367', 'request_id': 'req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:24.557089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502ccbcb55b84a478870c5a1d4721367', 'request_id': 'req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:24.557089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502ccbcb55b84a478870c5a1d4721367', 'request_id': 'req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:24.767702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] The token cache is being invalidate because project 502ccbcb55b84a478870c5a1d4721367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:24.769025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:24.769025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:24.770713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1009/2005] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:24 2022] DELETE /identity/v3/projects/502ccbcb55b84a478870c5a1d4721367 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:24.775506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0b3f-99ab-4aca-be95-d217740e4d40 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:24.776024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0b3f-99ab-4aca-be95-d217740e4d40 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:24.776120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0b3f-99ab-4aca-be95-d217740e4d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:24.797054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1ccd0b3f-99ab-4aca-be95-d217740e4d40 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:24.798328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1ccd0b3f-99ab-4aca-be95-d217740e4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:24.846738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:24.850224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:24.887242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 997/2006] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:24.891302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:24.892142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:24.892497 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:24.919166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:24.920645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:24.931992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 998/2007] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:24.935897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:24.948498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014ba0-2aa3-4e73-80d0-d082efa1c4cd None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:24.963828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:24.963828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:24.963828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:24.963828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:24.964988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:24.964988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:24.964988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:24.965357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378a715-b5e4-41b2-9f67-1fe8d3e153e9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:24.976212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:24.976212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:24.976212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:24.976212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] PATH_INFO: `/v3/users/6900c0cfa86a489b9be5aa533054cf8f` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:24.976728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6900c0cfa86a489b9be5aa533054cf8f)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:24.976814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 999/2008] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:55:24.979376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:24.980911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:24.991683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9f9c-cfa1-411d-abe9-aa45d35658d4 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:24.997066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:24.997730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:24.998023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:24.998288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:24.999586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.001677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.155182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1000/2009] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:24 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:25.156147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.238552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6900c0cfa86a489b9be5aa533054cf8f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:25.239284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6900c0cfa86a489b9be5aa533054cf8f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:25.246211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a17d4d-8551-44fd-997a-0a4bbcfce80f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:25.249233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6900c0cfa86a489b9be5aa533054cf8f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:25.250886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6900c0cfa86a489b9be5aa533054cf8f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:25.255128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:25.256490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.257008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.257681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.258590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.261584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.282463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab87e3fc-36b5-4828-8605-af0a59155437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6900c0cfa86a489b9be5aa533054cf8f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:25.376728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1001/2010] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:25 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:25.381946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.383748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:25.397086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e98eb6-faf6-4d5a-8e04-27652d80695f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:25.402577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:25.403716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.403716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.403716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.404447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.406366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.417014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1002/2011] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:25.421418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.430140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1010/2012] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:24 2022] DELETE /identity/v3/users/6900c0cfa86a489b9be5aa533054cf8f => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:25.432566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246e965-731f-4b76-b6eb-d66599a8dc90 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:25.434584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.434963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.435388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.460416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:25.461198 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:25.461593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:25.494692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:25.495383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.495677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.495998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.496761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.498380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.509856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1003/2013] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:25.514462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.524331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3ff8-8e02-4797-b19a-510afdd29193 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:25.528603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1011/2014] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:25.528962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537204c-4666-451b-b9bb-eedb1fd9d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:25.529682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537204c-4666-451b-b9bb-eedb1fd9d6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.530356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537204c-4666-451b-b9bb-eedb1fd9d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.530482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537204c-4666-451b-b9bb-eedb1fd9d6ad admin admin] PATH_INFO: `/v3/projects/c419fdbf6ea3420a9607fc7ff0009560/users/0043cfbea0f9457fbf7c9b3a54b2e111/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.540792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.542339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:25.552850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537204c-4666-451b-b9bb-eedb1fd9d6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c419fdbf6ea3420a9607fc7ff0009560, user_id=0043cfbea0f9457fbf7c9b3a54b2e111, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.555519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537204c-4666-451b-b9bb-eedb1fd9d6ad admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.602092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f095453-5523-49c3-a597-5c8e3e1ab1cf None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:25.605889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:25.606584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.606812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.607103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.617634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.619068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.626914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1004/2015] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:25 2022] PUT /identity/v3/projects/c419fdbf6ea3420a9607fc7ff0009560/users/0043cfbea0f9457fbf7c9b3a54b2e111/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:25.631237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1012/2016] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:25.633036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:25.637955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.638249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.638528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.671446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] MFA Rules not processed for user `0043cfbea0f9457fbf7c9b3a54b2e111`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:25.673745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:25.742884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1005/2017] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:25.747480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.758285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45764e5c-5705-41b0-8984-283eb5bfcb1e service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:25.818569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:25.819258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:25.819551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:25.819940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:25.820642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:25.822572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:25.973668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1013/2018] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:25 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:25.974908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:25.986982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850d5b7-7bc5-476a-806e-3576490f4248 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.061667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.061667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.061667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.061667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.062055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.064259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.066850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.068703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.086890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6cedf-d142-433c-8445-bbdbe5c31afb admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.092074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.093628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.094002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.094298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] PATH_INFO: `/v3/projects/aa434339a4e34864b3d55d1d8b6d3f82` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.095566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa434339a4e34864b3d55d1d8b6d3f82)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.097911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.161289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1006/2019] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:25 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:26.165248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.176393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5696-a0aa-4b4a-a119-9f2533f22635 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.182369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.183121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.183424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.183694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.184528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.186184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.200318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1007/2020] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:26.202602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.212760 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990d9c5-844b-40ec-81fa-b33c75e92773 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.221482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa434339a4e34864b3d55d1d8b6d3f82', 'request_id': 'req-ab3e0344-93d2-4d71-a1d5-589723516dfc'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.229941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa434339a4e34864b3d55d1d8b6d3f82', 'request_id': 'req-ab3e0344-93d2-4d71-a1d5-589723516dfc'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.237774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa434339a4e34864b3d55d1d8b6d3f82', 'request_id': 'req-ab3e0344-93d2-4d71-a1d5-589723516dfc'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.278223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.279025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.279313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.279597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] PATH_INFO: `/v3/projects/40483476762a4c879bf08a203b7def80/users/92d361a22b864e0ebd4308189630d5b2/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.297240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40483476762a4c879bf08a203b7def80, user_id=92d361a22b864e0ebd4308189630d5b2, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.299997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.339519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] The token cache is being invalidate because project aa434339a4e34864b3d55d1d8b6d3f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:26.349167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.349167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.349167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1014/2021] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:26 2022] DELETE /identity/v3/projects/aa434339a4e34864b3d55d1d8b6d3f82 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:26.349167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.349167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.362869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0344-93d2-4d71-a1d5-589723516dfc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.368198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.368945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.369156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.370077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] PATH_INFO: `/v3/users/e1c7348b62d34f8d98cb514f548fd4a8` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.374098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c7348b62d34f8d98cb514f548fd4a8)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.374098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.427295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1008/2022] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:26 2022] PUT /identity/v3/projects/40483476762a4c879bf08a203b7def80/users/92d361a22b864e0ebd4308189630d5b2/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:26.431352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.433128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.443749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:26.525184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4576-8850-42bd-806d-a9b5fe2b27c0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.531436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.532279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.532725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.532874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.533633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.535286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.548190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1009/2023] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:26.552277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.564872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24f151-c93b-4ed6-9573-dad673311a8a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.570613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eeeaf-4677-4558-84c0-fc311c3c7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.571314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eeeaf-4677-4558-84c0-fc311c3c7eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.571603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eeeaf-4677-4558-84c0-fc311c3c7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.571930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eeeaf-4677-4558-84c0-fc311c3c7eb7 admin admin] PATH_INFO: `/v3/projects/40483476762a4c879bf08a203b7def80/users/92d361a22b864e0ebd4308189630d5b2/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.575187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eeeaf-4677-4558-84c0-fc311c3c7eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40483476762a4c879bf08a203b7def80, user_id=92d361a22b864e0ebd4308189630d5b2, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.579593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eeeaf-4677-4558-84c0-fc311c3c7eb7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.601357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1010/2024] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:26 2022] PUT /identity/v3/projects/40483476762a4c879bf08a203b7def80/users/92d361a22b864e0ebd4308189630d5b2/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:26.601821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c7348b62d34f8d98cb514f548fd4a8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.601821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c7348b62d34f8d98cb514f548fd4a8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.603652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c7348b62d34f8d98cb514f548fd4a8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.604418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.604615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c7348b62d34f8d98cb514f548fd4a8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.604779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.605033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.619173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c7348b62d34f8d98cb514f548fd4a8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:26.638947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] MFA Rules not processed for user `92d361a22b864e0ebd4308189630d5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:26.641040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.712859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1011/2025] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:26.722475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1015/2026] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:26 2022] DELETE /identity/v3/users/e1c7348b62d34f8d98cb514f548fd4a8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:26.724957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:26.728815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.792481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c69d-bc92-4207-880c-bc5b9f350c9e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:26.851669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:26.852360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:26.852649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:26.852926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:26.855652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:26.925764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:26.927318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc4f0d-fb4c-48e5-8f3d-e3013f427b8a service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:26.938043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1012/2027] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:27.239070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:27.239070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:27.267163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:27.336151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe050-16a0-4b4b-94ae-44b935453ab7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:27.340736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:27.341391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:27.341680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:27.341956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] PATH_INFO: `/v3/projects/e519865c7e0f44e8a06b25e986f80284` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:27.343968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e519865c7e0f44e8a06b25e986f80284)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:27.347626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:27.475187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e519865c7e0f44e8a06b25e986f80284', 'request_id': 'req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:27.483957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e519865c7e0f44e8a06b25e986f80284', 'request_id': 'req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:27.492205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e519865c7e0f44e8a06b25e986f80284', 'request_id': 'req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:27.608537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] The token cache is being invalidate because project e519865c7e0f44e8a06b25e986f80284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:27.608843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:27.611248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-2ef4c6da-56eb-474a-b3ce-8a38ed70b78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:27.614864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1016/2028] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:27 2022] DELETE /identity/v3/projects/e519865c7e0f44e8a06b25e986f80284 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:27.619819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:27.620503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:27.620503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:27.644628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:27.645875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:27.689640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:27.719338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1013/2029] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:27.728224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:27.728680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:27.729126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:27.758742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:27.760102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:27.770300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1017/2030] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:27.774971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:27.787589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae42aa-f891-4db5-a806-7379d44d4293 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:27.793153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:27.805542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:27.805542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:27.805542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:27.805542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:27.805542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:27.805542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:27.816386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1014/2031] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:55:27.820648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:27.833612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06649740-a8bb-4709-84d8-60dcf632a5f5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:27.839960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:27.840598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:27.840914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:27.841197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:27.841895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:27.844676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:27.964128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1018/2032] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:27 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:27.972323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:27.982482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80db78-bceb-47e4-8b53-8819f873a18f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.054881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.055899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.056388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.056833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.057681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.061731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:28.215055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1015/2033] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:27 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:28.219985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:28.231848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989bcc5-2d35-4080-9125-2be228641676 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.237970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.238596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.238885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.239163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.239909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.241640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:28.252932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1019/2034] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:28.257400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:28.268549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34dfc9-a7e6-44d8-b097-3cd24c7b77f8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.273273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ea1a-50d0-430e-9261-4113fa3d0210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.278238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ea1a-50d0-430e-9261-4113fa3d0210 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.278238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ea1a-50d0-430e-9261-4113fa3d0210 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.278238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ea1a-50d0-430e-9261-4113fa3d0210 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.278238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111ea1a-50d0-430e-9261-4113fa3d0210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.278238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111ea1a-50d0-430e-9261-4113fa3d0210 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:28.289022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1016/2035] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:28.293327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:28.305823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e784-f13f-4e3b-9157-2baa66a99c3b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.312450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.312804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.313097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.313377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] PATH_INFO: `/v3/projects/8e3dbdd82bba4b3baf395c82de212852/users/08d34ea91e4842e0adfdc3c418eb447e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.329582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3dbdd82bba4b3baf395c82de212852, user_id=08d34ea91e4842e0adfdc3c418eb447e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.332338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:28.431010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1020/2036] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:28 2022] PUT /identity/v3/projects/8e3dbdd82bba4b3baf395c82de212852/users/08d34ea91e4842e0adfdc3c418eb447e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:28.444211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.444419 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.444712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.475802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] MFA Rules not processed for user `08d34ea91e4842e0adfdc3c418eb447e`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:28.477140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:28.545117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1017/2037] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:28.550769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:28.573610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:28.618546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f6d8b-2af1-4a1d-907f-37e44e1d8c0b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.623495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.624165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.624454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.624731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.625414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.627338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:28.747147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1021/2038] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:28 2022] POST /identity/v3/projects => generated 391 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:28.751520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:28.762683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb434d4-d8f3-4937-89f7-e41c974e22ac None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.768192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:28.822986 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.823709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.824034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.824321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.825020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.827409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:28.949987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:28.954193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1018/2039] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:28 2022] POST /identity/v3/users => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:28.958289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:28.972579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67517-8ad7-4ae2-8f5c-3c7780996bb5 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:28.982073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:28.984299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:28.984942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:28.985397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:28.986916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:28.989182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:29.026446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1022/2040] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:29.035849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:29.067607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863d1a-87ff-4dbf-9271-36d227481e9c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:29.074081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:29.074934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:29.075418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:29.075644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] PATH_INFO: `/v3/projects/a054f10436bc4a75b681c9d3a71af36f/users/62fa41aa7fc94c04b84989df74003bc2/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:29.097633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a054f10436bc4a75b681c9d3a71af36f, user_id=62fa41aa7fc94c04b84989df74003bc2, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:29.100870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:29.233826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1019/2041] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:29 2022] PUT /identity/v3/projects/a054f10436bc4a75b681c9d3a71af36f/users/62fa41aa7fc94c04b84989df74003bc2/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:29.236758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:29.248405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1253ad-24ff-4861-8480-2bb00babf0f3 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:29.333924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a361-3668-42ed-87ed-1ec6738acec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:29.334582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a361-3668-42ed-87ed-1ec6738acec3 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:29.334899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a361-3668-42ed-87ed-1ec6738acec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:29.335242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a361-3668-42ed-87ed-1ec6738acec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:29.336243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110a361-3668-42ed-87ed-1ec6738acec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:29.338122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110a361-3668-42ed-87ed-1ec6738acec3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:29.350737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1023/2042] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:29.355223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:29.368480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e927-3119-4641-bc1e-6a0ce80a8894 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:29.374492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:29.375577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:29.376522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:29.376522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] PATH_INFO: `/v3/projects/a054f10436bc4a75b681c9d3a71af36f/users/62fa41aa7fc94c04b84989df74003bc2/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:29.378925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a054f10436bc4a75b681c9d3a71af36f, user_id=62fa41aa7fc94c04b84989df74003bc2, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:29.381451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:29.399818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1020/2043] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:29 2022] PUT /identity/v3/projects/a054f10436bc4a75b681c9d3a71af36f/users/62fa41aa7fc94c04b84989df74003bc2/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:29.409028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65531f2e-ad22-4106-a553-4413085a922c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:29.409459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65531f2e-ad22-4106-a553-4413085a922c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:29.409908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65531f2e-ad22-4106-a553-4413085a922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:29.459154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-65531f2e-ad22-4106-a553-4413085a922c None None] MFA Rules not processed for user `62fa41aa7fc94c04b84989df74003bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:29.460673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-65531f2e-ad22-4106-a553-4413085a922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:29.566724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1024/2044] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:29.579594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:29.582551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:29.658070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704d16-b1bd-49c1-964b-82811fdbf45e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:29.662090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:29.662728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:29.663015 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:29.663299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:29.682590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:29.685324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:29.698491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1021/2045] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:29.755735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65531f2e-ad22-4106-a553-4413085a922c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:29.767639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65531f2e-ad22-4106-a553-4413085a922c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:29.771528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:29.772365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:29.772666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:29.772935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:29.852015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:29.855649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:29.865741 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1025/2046] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:30.408724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:33.822213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:33.833939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c0dd-6557-4341-982d-e00aca73fcd7 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:33.837854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:33.838598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:33.838887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:33.839194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:33.841855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:33.925763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:33.927226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd57b4-a2a3-4b9c-8dcc-a81b07e1da11 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:33.940275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1022/2047] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:35.970859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:36.012268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:36.051039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af53e8-feb6-4374-a23d-e58fd1a5d9bb service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:36.057220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:36.060590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:36.061799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:36.062428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] PATH_INFO: `/v3/users/08d34ea91e4842e0adfdc3c418eb447e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:36.065599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d34ea91e4842e0adfdc3c418eb447e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:36.068215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:36.243101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd814475-7354-4a78-ba28-0b44b93556d5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:36.243661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd814475-7354-4a78-ba28-0b44b93556d5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:36.243661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd814475-7354-4a78-ba28-0b44b93556d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:36.264889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cd814475-7354-4a78-ba28-0b44b93556d5 None None] MFA Rules not processed for user `7f54b07b4dbc4e67b44a1c3ff6d60226`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:36.266341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cd814475-7354-4a78-ba28-0b44b93556d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:36.358602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:36.379626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d34ea91e4842e0adfdc3c418eb447e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:36.386062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d34ea91e4842e0adfdc3c418eb447e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:36.391910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d34ea91e4842e0adfdc3c418eb447e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:36.397330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1023/2048] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:36.397613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d34ea91e4842e0adfdc3c418eb447e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:36.408583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0e95bf9c-6210-43e9-b837-f2ea18d8eff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d34ea91e4842e0adfdc3c418eb447e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:36.537387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1026/2049] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:35 2022] DELETE /identity/v3/users/08d34ea91e4842e0adfdc3c418eb447e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:36.542495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:36.542797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:36.543264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:36.596737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:36.601046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:36.629398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:36.631513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:36.631513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:36.671337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:36.673893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:36.754559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1024/2050] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:36.781276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:36.783734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:36.808602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1027/2051] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:55:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:36.869206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c46f-4080-4648-83b1-90ecc6319210 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:36.869918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:36.871847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:36.876030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:36.876681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:36.876966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:36.877257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:36.900754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:36.902422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:36.915433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1025/2052] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:36.954449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:36.981126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87084a31-776a-43a5-9414-4d73a9dc5f58 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:36.985647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:36.986430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:36.986541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:36.986820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:37.001242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:37.003136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:37.016341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1028/2053] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:55:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 22:55:37.741989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:37.744611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:37.799053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc26de4-36f1-4ee6-8576-0384ed01d71c service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:37.844404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:37.845139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:37.845428 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:37.845705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] PATH_INFO: `/v3/projects/8e3dbdd82bba4b3baf395c82de212852` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:37.857512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3dbdd82bba4b3baf395c82de212852)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:37.867036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:38.082113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3dbdd82bba4b3baf395c82de212852', 'request_id': 'req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.242560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3dbdd82bba4b3baf395c82de212852', 'request_id': 'req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.258998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3dbdd82bba4b3baf395c82de212852', 'request_id': 'req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.274865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] The token cache is being invalidate because project 8e3dbdd82bba4b3baf395c82de212852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:38.275982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.277100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.282689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1026/2054] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:37 2022] DELETE /identity/v3/projects/8e3dbdd82bba4b3baf395c82de212852 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:38.283836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:38.322500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d65ae-81d0-488b-94cb-ea97b3b567d5 service swift] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:38.443054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da244607-d195-4197-8651-baac553f5929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:38.443795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244607-d195-4197-8651-baac553f5929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:38.444886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244607-d195-4197-8651-baac553f5929 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:38.445260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244607-d195-4197-8651-baac553f5929 admin admin] PATH_INFO: `/v3/users/62fa41aa7fc94c04b84989df74003bc2` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:38.450851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da244607-d195-4197-8651-baac553f5929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62fa41aa7fc94c04b84989df74003bc2)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:38.455180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da244607-d195-4197-8651-baac553f5929 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:38.722102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-da244607-d195-4197-8651-baac553f5929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62fa41aa7fc94c04b84989df74003bc2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.723419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-da244607-d195-4197-8651-baac553f5929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62fa41aa7fc94c04b84989df74003bc2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.736064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-da244607-d195-4197-8651-baac553f5929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62fa41aa7fc94c04b84989df74003bc2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.736865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-da244607-d195-4197-8651-baac553f5929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62fa41aa7fc94c04b84989df74003bc2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.769529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-da244607-d195-4197-8651-baac553f5929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62fa41aa7fc94c04b84989df74003bc2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:38.893512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1029/2055] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:38 2022] DELETE /identity/v3/users/62fa41aa7fc94c04b84989df74003bc2 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:39.787882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:39.790184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:39.854059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebff6-8b35-4eb8-81cf-4a868bf9f20c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:39.949158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:40.115080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:40.115080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:40.115080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:40.115080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] PATH_INFO: `/v3/projects/a054f10436bc4a75b681c9d3a71af36f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:40.118013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a054f10436bc4a75b681c9d3a71af36f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:40.127938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:40.394977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a054f10436bc4a75b681c9d3a71af36f', 'request_id': 'req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:40.467526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a054f10436bc4a75b681c9d3a71af36f', 'request_id': 'req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:40.489382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a054f10436bc4a75b681c9d3a71af36f', 'request_id': 'req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:40.514878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] The token cache is being invalidate because project a054f10436bc4a75b681c9d3a71af36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:40.518915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:40.518915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df6e0bfe-1a27-45c9-ab7c-8ef7eb0eb585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:40.523802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1027/2056] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:39 2022] DELETE /identity/v3/projects/a054f10436bc4a75b681c9d3a71af36f => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:40.525787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:40.526307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:40.526568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:40.571348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:40.578629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:40.727406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1030/2057] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:40.734732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:40.735024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:40.735307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:40.789500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:40.792711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:40.808787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1028/2058] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:40.810333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:40.819579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:40.822706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75869fcd-4123-44c9-ae0b-79d726376504 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:40.829961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:40.831229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:40.831617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:40.832033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:40.836444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:40.836444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:40.848103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:40.857480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:40.859186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:40.912612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1031/2059] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:55:40.913759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:40.917310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bac16-0e9b-4153-b581-be38d671710e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:40.938793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3aae-5b7b-4b43-999f-d6ab3eb688a9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:40.944196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:40.945377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:40.945773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:40.946162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:40.946985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:40.949917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:40.974447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:40.975589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:40.976142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:40.976625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] PATH_INFO: `/v3/users/0043cfbea0f9457fbf7c9b3a54b2e111` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:40.981769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0043cfbea0f9457fbf7c9b3a54b2e111)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:40.987075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:41.124709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1032/2060] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:40 2022] POST /identity/v3/projects => generated 399 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:41.129735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:41.236509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a62b49-f953-4fe5-9d69-5a3ea7d0e44d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:41.249542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:41.251030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.251472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.251848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.252667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:41.255302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:41.339037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0043cfbea0f9457fbf7c9b3a54b2e111'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:41.344892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0043cfbea0f9457fbf7c9b3a54b2e111'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:41.377020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1033/2061] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:41 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:41.389034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:41.415122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c4bb-0ac9-4c61-b992-237bc738b4ce admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:41.436503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:41.436503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.446453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.446453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.446453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:41.446453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:41.459901 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0043cfbea0f9457fbf7c9b3a54b2e111'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:41.460576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0043cfbea0f9457fbf7c9b3a54b2e111'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:41.470156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1034/2062] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:41.476097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:41.478023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:41.507305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4087e1b-dc33-42f4-9302-23c51dbd23d9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:41.515987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:41.516822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.518286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.518912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f547c3ed-d619-43a2-9205-69623f6d2e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0043cfbea0f9457fbf7c9b3a54b2e111'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:41.519264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.520449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:41.528078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:41.538885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1035/2063] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:41.542890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:41.564707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1029/2064] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:40 2022] DELETE /identity/v3/users/0043cfbea0f9457fbf7c9b3a54b2e111 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:41.571106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.572446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.573544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.577470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0d87-9b0b-4422-923c-c735e781d706 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:41.628026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:41.632121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:41.684187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46bb50-1f8d-4378-8768-c5ccb0f250d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:41.685202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:41.687313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46bb50-1f8d-4378-8768-c5ccb0f250d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.687985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46bb50-1f8d-4378-8768-c5ccb0f250d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.690131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46bb50-1f8d-4378-8768-c5ccb0f250d3 admin admin] PATH_INFO: `/v3/projects/24f3b961040d49eca052355080a38550/users/d4fd7f3873b84ebfb0866b7d15202858/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.738024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46bb50-1f8d-4378-8768-c5ccb0f250d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f3b961040d49eca052355080a38550, user_id=d4fd7f3873b84ebfb0866b7d15202858, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:41.744742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46bb50-1f8d-4378-8768-c5ccb0f250d3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:41.771845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1030/2065] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:41.836130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:41.839158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:41.856498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1036/2066] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:41 2022] PUT /identity/v3/projects/24f3b961040d49eca052355080a38550/users/d4fd7f3873b84ebfb0866b7d15202858/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:41.869264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:41.869931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:41.870442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:41.960171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] MFA Rules not processed for user `d4fd7f3873b84ebfb0866b7d15202858`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:41.965461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:42.007802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:42.034458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f53d-20f4-432c-b9da-16474bcb1c3e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.162108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.162309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.162601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.162888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.199529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1037/2067] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:42.206638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:42.287183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.290758 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:42.308928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1031/2068] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:42.333507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76deb-54d9-4726-98eb-7879dbc6d5f5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.339338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.340031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.340320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.340600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.341299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.344464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:42.464569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1038/2069] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:42 2022] POST /identity/v3/projects => generated 401 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:42.466781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:42.481337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adee68-1f2c-4489-aa35-85ff5a4d09ce service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.534485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:42.629645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.631572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.633940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.635025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.640195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.654213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:42.802423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1032/2070] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:42 2022] POST /identity/v3/users => generated 307 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:42.805346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:42.838294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49ba9-4fc4-4bfa-948e-bf6414ceabdf admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.851015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.851664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.852108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.859915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.859915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.859915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:42.886025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:42.887297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:42.905395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1039/2071] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:42.906499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:42.917036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c2f8-e394-4aae-a4b6-78fbfc51b7a6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.928247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.928927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.929204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.929473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] PATH_INFO: `/v3/projects/c419fdbf6ea3420a9607fc7ff0009560` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.930757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c419fdbf6ea3420a9607fc7ff0009560)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.932771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:42.932945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89308e-d7bf-4b2e-b7a6-97c01f41611e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:42.943678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:42.944411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:42.944705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:42.944993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] PATH_INFO: `/v3/projects/a77e49ccc30c4428bc58ef26530eef0e/users/91ddd5b1010a4e0d8754f479c739e7ae/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:42.984638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77e49ccc30c4428bc58ef26530eef0e, user_id=91ddd5b1010a4e0d8754f479c739e7ae, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:42.987668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:43.095386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1040/2072] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:42 2022] PUT /identity/v3/projects/a77e49ccc30c4428bc58ef26530eef0e/users/91ddd5b1010a4e0d8754f479c739e7ae/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:43.100081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:43.128673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c419fdbf6ea3420a9607fc7ff0009560', 'request_id': 'req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.196461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c419fdbf6ea3420a9607fc7ff0009560', 'request_id': 'req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.217322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c419fdbf6ea3420a9607fc7ff0009560', 'request_id': 'req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.248405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] The token cache is being invalidate because project c419fdbf6ea3420a9607fc7ff0009560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:43.249770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.262273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.280263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efdac8-7734-4150-9d8b-9519358f35cf admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:43.283670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1033/2073] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:42 2022] DELETE /identity/v3/projects/c419fdbf6ea3420a9607fc7ff0009560 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:43.293611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:43.305125 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:43.306150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:43.467724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:43.468909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:43.469361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:43.469908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:43.473051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:43.480738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:43.512034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1041/2074] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:43.517116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:43.519298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:43.548656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caddd4-be17-4e2e-b381-42d10871a801 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:43.555422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7199da4-725f-49ed-a2f3-2ee561f71a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:43.557720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199da4-725f-49ed-a2f3-2ee561f71a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:43.560178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0a6a5-e3e3-41c7-99d5-0414a5dc041b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:43.560746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199da4-725f-49ed-a2f3-2ee561f71a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:43.561173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199da4-725f-49ed-a2f3-2ee561f71a0d admin admin] PATH_INFO: `/v3/projects/a77e49ccc30c4428bc58ef26530eef0e/users/91ddd5b1010a4e0d8754f479c739e7ae/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:43.564194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7199da4-725f-49ed-a2f3-2ee561f71a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77e49ccc30c4428bc58ef26530eef0e, user_id=91ddd5b1010a4e0d8754f479c739e7ae, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:43.566934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7199da4-725f-49ed-a2f3-2ee561f71a0d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:43.573953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:43.580076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:43.580076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:43.580076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] PATH_INFO: `/v3/users/92d361a22b864e0ebd4308189630d5b2` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:43.580076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d361a22b864e0ebd4308189630d5b2)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:43.581152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:43.599930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1042/2075] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:43 2022] PUT /identity/v3/projects/a77e49ccc30c4428bc58ef26530eef0e/users/91ddd5b1010a4e0d8754f479c739e7ae/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:43.609982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611caf-5464-4f70-911b-890617799412 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:43.615105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611caf-5464-4f70-911b-890617799412 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:43.615105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611caf-5464-4f70-911b-890617799412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:43.691591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-da611caf-5464-4f70-911b-890617799412 None None] MFA Rules not processed for user `91ddd5b1010a4e0d8754f479c739e7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:43.692962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-da611caf-5464-4f70-911b-890617799412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:43.834677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1043/2076] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:43.867507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da611caf-5464-4f70-911b-890617799412 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:43.872388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-da611caf-5464-4f70-911b-890617799412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:43.890654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:43.904162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d361a22b864e0ebd4308189630d5b2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.908126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d361a22b864e0ebd4308189630d5b2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.996667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d361a22b864e0ebd4308189630d5b2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:43.997239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d361a22b864e0ebd4308189630d5b2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:44.022553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d361a22b864e0ebd4308189630d5b2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:44.043179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1034/2077] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:43 2022] DELETE /identity/v3/users/92d361a22b864e0ebd4308189630d5b2 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:44.067297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da611caf-5464-4f70-911b-890617799412 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:44.119847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:44.156411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:44.157111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:44.157403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:44.157718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:44.159912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:44.307220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:44.308938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:44.327376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1044/2078] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:44.585456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:44.590503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:44.621458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126684-7c2d-4600-8b93-2b35d30c784c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:44.637510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:44.638240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:44.638606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:44.640505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:44.647298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:44.803469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:44.805011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73819-64e5-4b5f-8133-e1a761da0698 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:44.819949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1035/2079] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:45.120349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:45.122968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:45.293553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50542a-55c0-422b-b96d-5b0ab99ad457 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:45.301501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:45.310851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:45.310851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:45.310851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] PATH_INFO: `/v3/projects/40483476762a4c879bf08a203b7def80` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:45.310851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40483476762a4c879bf08a203b7def80)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:45.310851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:45.457523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40483476762a4c879bf08a203b7def80', 'request_id': 'req-29512672-2c8a-4ef7-b85f-0bff33e89491'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:45.470299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40483476762a4c879bf08a203b7def80', 'request_id': 'req-29512672-2c8a-4ef7-b85f-0bff33e89491'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:45.478640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40483476762a4c879bf08a203b7def80', 'request_id': 'req-29512672-2c8a-4ef7-b85f-0bff33e89491'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:45.646121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] The token cache is being invalidate because project 40483476762a4c879bf08a203b7def80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:45.653970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:45.653970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-29512672-2c8a-4ef7-b85f-0bff33e89491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:45.653970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1045/2080] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:45 2022] DELETE /identity/v3/projects/40483476762a4c879bf08a203b7def80 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:45.656017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:45.656484 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:45.656589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:45.722226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:45.730281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:45.871892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1036/2081] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:45.881699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:45.882056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:45.882342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:45.915657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:45.918068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:45.933275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1046/2082] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:45.946218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:45.976253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4710-fd14-4888-ace8-b11370881fe0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:45.988481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:45.989192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:45.989467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:45.989749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:45.990477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:45.990796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:45.992523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:46.034810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1037/2083] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:55:46.038855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:46.048406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:46.059508 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be0dc-b992-4d89-bb73-93f54274e049 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:46.098455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:46.101399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:46.101725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:46.102011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:46.102729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:46.118690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:46.316816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1047/2084] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:46 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:46.319291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:46.336405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172612e-d2a3-4f9d-a42a-f9ca9124594b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:46.414857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:46.430786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:46.431635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:46.432358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:46.432747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:46.433617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:46.436129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:46.648127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1038/2085] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:46 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:46.662971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:46.688972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88e4a2-6f88-4d30-8a78-4201ac61d3ac admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:46.694842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:46.696004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:46.696460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:46.696896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:46.697985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:46.699979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:46.728267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1048/2086] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:46.729751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:46.743652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfb10-dfe8-4634-95e4-be20d629254d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:46.759359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53bc1d-6581-479d-a760-68381e6dadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:46.760211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53bc1d-6581-479d-a760-68381e6dadc6 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:46.760672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53bc1d-6581-479d-a760-68381e6dadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:46.761074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53bc1d-6581-479d-a760-68381e6dadc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:46.761900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53bc1d-6581-479d-a760-68381e6dadc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:46.764795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53bc1d-6581-479d-a760-68381e6dadc6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:46.797472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1039/2087] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:46.802793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:46.814143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04d2a2-e596-48d2-bc06-2dd329405cfc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:46.818673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:46.819618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:46.819939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:46.820228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] PATH_INFO: `/v3/projects/dcf87c58c6374d15ad23134549419362/users/1f3e1f5e1b964bc0a1d89cea265bbb06/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:46.841396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf87c58c6374d15ad23134549419362, user_id=1f3e1f5e1b964bc0a1d89cea265bbb06, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:46.845522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:46.935448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1049/2088] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:46 2022] PUT /identity/v3/projects/dcf87c58c6374d15ad23134549419362/users/1f3e1f5e1b964bc0a1d89cea265bbb06/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:46.954430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:46.954890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:46.955579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:47.018652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] MFA Rules not processed for user `1f3e1f5e1b964bc0a1d89cea265bbb06`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:47.023013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:47.297245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1040/2089] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:47.323390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:47.329928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:47.485820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901745-60cf-422a-9c69-51064fb58fbe admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:47.492992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff30df-7bbb-4cf1-8e9c-d54ab2b9f09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:47.494774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff30df-7bbb-4cf1-8e9c-d54ab2b9f09e service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:47.495515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff30df-7bbb-4cf1-8e9c-d54ab2b9f09e service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:47.496298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff30df-7bbb-4cf1-8e9c-d54ab2b9f09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:47.520214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff30df-7bbb-4cf1-8e9c-d54ab2b9f09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:47.523315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff30df-7bbb-4cf1-8e9c-d54ab2b9f09e service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:47.542282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1050/2090] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:47.610344 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:47.834952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383f596-e87b-47f3-98a1-27f9252aade4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:47.844936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:47.846281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:47.846999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:47.847816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] PATH_INFO: `/v3/users/1f3e1f5e1b964bc0a1d89cea265bbb06` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:47.851798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3e1f5e1b964bc0a1d89cea265bbb06)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:47.856092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:48.207932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3e1f5e1b964bc0a1d89cea265bbb06'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:48.209155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3e1f5e1b964bc0a1d89cea265bbb06'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:48.293770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3e1f5e1b964bc0a1d89cea265bbb06'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:48.294535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3e1f5e1b964bc0a1d89cea265bbb06'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:48.308008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:48.326550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3e1f5e1b964bc0a1d89cea265bbb06'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:48.353120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1041/2091] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:47 2022] DELETE /identity/v3/users/1f3e1f5e1b964bc0a1d89cea265bbb06 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:48.354826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:48.355428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:48.355428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:48.378860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:48.380234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:48.487739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1051/2092] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:48.499997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:48.501844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:48.608753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4bdbb-e901-4591-990c-3143f104d84a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:48.616298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe252a69-dd7e-4471-861a-f69286ca8e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:48.616298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe252a69-dd7e-4471-861a-f69286ca8e4a service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:48.616936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe252a69-dd7e-4471-861a-f69286ca8e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:48.617473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe252a69-dd7e-4471-861a-f69286ca8e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:48.642167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe252a69-dd7e-4471-861a-f69286ca8e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:48.644448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe252a69-dd7e-4471-861a-f69286ca8e4a service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:48.665930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1042/2093] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:50.284117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:50.289540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:50.359599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465ae09-a0ec-4848-b647-2ea5c50e263e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:50.382533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:50.384025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:50.384463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:50.384790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] PATH_INFO: `/v3/projects/dcf87c58c6374d15ad23134549419362` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:50.391054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf87c58c6374d15ad23134549419362)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:50.394758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:50.621414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:50.631113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf87c58c6374d15ad23134549419362', 'request_id': 'req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:50.642965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf87c58c6374d15ad23134549419362', 'request_id': 'req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:50.655795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf87c58c6374d15ad23134549419362', 'request_id': 'req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:50.777283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] The token cache is being invalidate because project dcf87c58c6374d15ad23134549419362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:50.778132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:50.784064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-eaf580a8-d70d-4b53-84b3-73638a1ed7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:50.789166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1052/2094] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:50 2022] DELETE /identity/v3/projects/dcf87c58c6374d15ad23134549419362 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:50.801814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:50.804846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:50.805531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:50.897785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:50.915557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:51.146437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1043/2095] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:51.156848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:51.157838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:51.158537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:51.212657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:51.221409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:51.250349 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1053/2096] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:55:51.255808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:51.275968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be20efa-de65-4938-b1d3-1304216b7374 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:51.304169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:51.305588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:51.306179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:51.306806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:51.308157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:51.310012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:51.318257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:51.343261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1044/2097] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:55:51.348244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:51.385938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae0065-782f-4f49-8252-bea9cc10c524 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:51.422910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:51.424522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:51.429611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:51.430129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:51.443796 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:51.462613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:51.673047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1054/2098] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:51 2022] POST /identity/v3/projects => generated 381 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:51.677781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:51.741417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:51.745469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:51.755368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09ff3-dc6d-406a-a8b4-be0b5b04d62d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:51.952135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:51.953262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:51.953262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:51.953262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:51.953724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:51.955890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:51.971729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:51.976586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011ccd-ef42-4a29-aef2-936423d2809f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:51.985289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:51.986430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:51.986941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:51.987450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] PATH_INFO: `/v3/users/d4fd7f3873b84ebfb0866b7d15202858` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:51.989690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fd7f3873b84ebfb0866b7d15202858)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:51.993701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:52.118665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1045/2099] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:51 2022] POST /identity/v3/users => generated 291 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:52.119865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:52.144927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164151-49ed-409b-b2d2-6c41be767d3a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:52.164840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:52.166745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:52.167752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:52.180588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:52.180588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:52.180588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:52.202406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1046/2100] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:52.209753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:52.229781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72515b5a-a7fa-4ec4-ac18-b58625cc24d2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:52.251751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e091d-75bb-44d3-9d0e-beea1af2389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:52.256568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e091d-75bb-44d3-9d0e-beea1af2389f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:52.257093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e091d-75bb-44d3-9d0e-beea1af2389f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:52.257514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e091d-75bb-44d3-9d0e-beea1af2389f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:52.258749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e091d-75bb-44d3-9d0e-beea1af2389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:52.269115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e091d-75bb-44d3-9d0e-beea1af2389f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:52.300662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1047/2101] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:52.303811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997834-8a8a-4e80-aa17-c84e8d5e4c9e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:52.304287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997834-8a8a-4e80-aa17-c84e8d5e4c9e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:52.310353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997834-8a8a-4e80-aa17-c84e8d5e4c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:52.317778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fd7f3873b84ebfb0866b7d15202858'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:52.318846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fd7f3873b84ebfb0866b7d15202858'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:52.336586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fd7f3873b84ebfb0866b7d15202858'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:52.338044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fd7f3873b84ebfb0866b7d15202858'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:52.354334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ef997834-8a8a-4e80-aa17-c84e8d5e4c9e None None] MFA Rules not processed for user `0940cde66b1247b89a34b60a3dbe3452`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:52.356866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ef997834-8a8a-4e80-aa17-c84e8d5e4c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:52.375520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fd7f3873b84ebfb0866b7d15202858'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:52.483450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1055/2102] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:51 2022] DELETE /identity/v3/users/d4fd7f3873b84ebfb0866b7d15202858 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:52.486151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:52.490874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:52.562915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1048/2103] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:52.565586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:52.566048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:52.571109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:52.604096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:52.671389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:52.677582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:52.883659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4aaa68-59b0-4bbe-9d1d-03c72005c6e1 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:52.928047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65a122-6761-40f7-8ba9-0bfce0eb5d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:52.935532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a122-6761-40f7-8ba9-0bfce0eb5d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:52.938095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a122-6761-40f7-8ba9-0bfce0eb5d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:52.946558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a122-6761-40f7-8ba9-0bfce0eb5d62 admin admin] PATH_INFO: `/v3/projects/d6fd500efd6b4ea48e3d981cad8eb995/users/cf6cd4f44dbd408196059977fe78885e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:52.997445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65a122-6761-40f7-8ba9-0bfce0eb5d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fd500efd6b4ea48e3d981cad8eb995, user_id=cf6cd4f44dbd408196059977fe78885e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:53.005210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65a122-6761-40f7-8ba9-0bfce0eb5d62 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:53.022946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1049/2104] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:53.043829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:53.048604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:53.132010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1056/2105] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:52 2022] PUT /identity/v3/projects/d6fd500efd6b4ea48e3d981cad8eb995/users/cf6cd4f44dbd408196059977fe78885e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:53.137156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:53.143591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:53.146986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:53.215200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:53.224296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:53.226987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f37fe5-3261-4da6-b0d0-db928eef3f4e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:53.314215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:53.342587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:53.345925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:53.346379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:53.346786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:53.381445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1057/2106] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:53.412381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:53.412381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:53.463952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7b64d-ad64-4c50-82bb-38235eea316a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:53.470407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:53.473367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:53.481874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:53.483144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:53.483845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:53.484329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:53.502759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:53.504664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:53.511968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1050/2107] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:53.530817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1058/2108] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:54.173086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:54.179361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:54.243508 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540a57-60ba-4c64-a75c-ba457a9439aa service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:54.280931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:54.281846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:54.282342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:54.282806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] PATH_INFO: `/v3/projects/24f3b961040d49eca052355080a38550` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:54.293481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f3b961040d49eca052355080a38550)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:54.303961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:54.498480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f3b961040d49eca052355080a38550', 'request_id': 'req-5395a171-971e-45ce-80bf-db6494d60758'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:54.582446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f3b961040d49eca052355080a38550', 'request_id': 'req-5395a171-971e-45ce-80bf-db6494d60758'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:54.596220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f3b961040d49eca052355080a38550', 'request_id': 'req-5395a171-971e-45ce-80bf-db6494d60758'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:54.625386 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] The token cache is being invalidate because project 24f3b961040d49eca052355080a38550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:54.626102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:54.627288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5395a171-971e-45ce-80bf-db6494d60758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:54.629862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1051/2109] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:54 2022] DELETE /identity/v3/projects/24f3b961040d49eca052355080a38550 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:54.633995 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:54.653252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5098bd-6335-4160-9206-d9dd7fdaba86 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:54.853821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:54.854642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:54.855116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:54.855468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] PATH_INFO: `/v3/users/91ddd5b1010a4e0d8754f479c739e7ae` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:54.856901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ddd5b1010a4e0d8754f479c739e7ae)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:54.859558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:55.270805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:55.287301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ddd5b1010a4e0d8754f479c739e7ae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:55.288739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ddd5b1010a4e0d8754f479c739e7ae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:55.316437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ddd5b1010a4e0d8754f479c739e7ae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:55.317388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ddd5b1010a4e0d8754f479c739e7ae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:55.377839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ddd5b1010a4e0d8754f479c739e7ae'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:55.476229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1059/2110] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:54 2022] DELETE /identity/v3/users/91ddd5b1010a4e0d8754f479c739e7ae => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:55.963033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:55.963600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:55.964466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.048172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] MFA Rules not processed for user `cf6cd4f44dbd408196059977fe78885e`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:56.050108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.207203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:56.230387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1052/2111] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:56.252334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.254914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.329532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.332584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.363851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae50af-165c-46ff-be5d-a9db32cd3b69 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.386728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e270c1-7877-4b14-aa59-c68169aaf72a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.387437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e270c1-7877-4b14-aa59-c68169aaf72a service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.387792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e270c1-7877-4b14-aa59-c68169aaf72a service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.387997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e270c1-7877-4b14-aa59-c68169aaf72a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.419185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e270c1-7877-4b14-aa59-c68169aaf72a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.430411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e270c1-7877-4b14-aa59-c68169aaf72a service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.438401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1060/2112] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:56.482559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c608e82-375d-47e3-96fc-a44ccaefcf56 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.488872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.489838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.494848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.495652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] PATH_INFO: `/v3/projects/a77e49ccc30c4428bc58ef26530eef0e` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.501549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77e49ccc30c4428bc58ef26530eef0e)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.509653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.803944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77e49ccc30c4428bc58ef26530eef0e', 'request_id': 'req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.910070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77e49ccc30c4428bc58ef26530eef0e', 'request_id': 'req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.929063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77e49ccc30c4428bc58ef26530eef0e', 'request_id': 'req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.979309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] The token cache is being invalidate because project a77e49ccc30c4428bc58ef26530eef0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:56.981671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.987266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c25c51e3-0125-4611-8d2a-8ae6de5f2cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.995257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1053/2113] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:56 2022] DELETE /identity/v3/projects/a77e49ccc30c4428bc58ef26530eef0e => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:57.004295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.004896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.005530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.053717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:57.056226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:57.179623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1061/2114] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:57.181259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.181559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.181845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.210911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:57.216245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:57.229883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1054/2115] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:57.235289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.248383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f850b-b3de-4f6f-b300-2daa2ed5e184 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.266418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.268464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.269020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.269539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.270793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:57.271341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:57.273655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:57.311505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1062/2116] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:55:57.316400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.343478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3eeb8-b5b3-44c3-8ce0-8cd3e71f72f2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.353013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.354255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.354642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.355054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.356475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:57.361563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:57.514354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1055/2117] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:57 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:55:57.516057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.542980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c49dd-93d1-4aea-b9d4-5d7a636d3c89 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.625652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:57.677101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.678250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.678651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.679133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.679946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:57.683081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:57.808334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1063/2118] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:57 2022] POST /identity/v3/users => generated 284 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:57.814511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.828152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f461b5-2c43-477c-98f1-d3abe26e986f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.834514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.837237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.837237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.837237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.837237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:57.840364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:57.861555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1056/2119] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:57.868299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.889606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb6afd-b6df-4eea-ade1-320d2559e4dd admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.896936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff11fc-5341-4a03-81e5-51714762d0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.898833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff11fc-5341-4a03-81e5-51714762d0ea admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.899322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff11fc-5341-4a03-81e5-51714762d0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.899750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff11fc-5341-4a03-81e5-51714762d0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.901609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff11fc-5341-4a03-81e5-51714762d0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:57.907470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff11fc-5341-4a03-81e5-51714762d0ea admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:57.927832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1064/2120] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:57.932397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.953942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc373dc-555f-4a86-bb5a-54dd0e676034 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.976698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.977704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.978221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.978662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] PATH_INFO: `/v3/projects/f1fcbc0c02774283aa0e19b5059261d6/users/2ea04b530b03408198189bc54119517e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:58.111519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fcbc0c02774283aa0e19b5059261d6, user_id=2ea04b530b03408198189bc54119517e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:58.114452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:58.228270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1057/2121] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:57 2022] PUT /identity/v3/projects/f1fcbc0c02774283aa0e19b5059261d6/users/2ea04b530b03408198189bc54119517e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:58.258987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b293-5e1e-476e-921e-33e9ba642149 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:58.260211 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b293-5e1e-476e-921e-33e9ba642149 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:58.260895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b293-5e1e-476e-921e-33e9ba642149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:58.317881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4d12b293-5e1e-476e-921e-33e9ba642149 None None] MFA Rules not processed for user `2ea04b530b03408198189bc54119517e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:58.317881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4d12b293-5e1e-476e-921e-33e9ba642149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:58.491295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1065/2122] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:58.496334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:58.589055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:58.605707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:58.606970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:58.610092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:58.656376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] MFA Rules not processed for user `cf6cd4f44dbd408196059977fe78885e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:58.659101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:58.740650 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897aa3f-7e14-4bee-90c9-90750d952a17 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:58.754276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:58.755393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:58.756175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:58.756664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:58.758126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:58.762250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:58.815668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1066/2123] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:58.895102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1058/2124] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:58 2022] POST /identity/v3/projects => generated 367 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:58.900469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:58.936992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289717-c951-4c5b-8911-fbe39dfe6d69 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:59.034305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:59.048237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:59.050422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:59.051035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:59.051673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:59.055282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:59.062420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:59.203034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1067/2125] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:58 2022] POST /identity/v3/users => generated 290 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:59.204357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:59.221597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69fc7-5a80-41d5-aef1-f5544c26aa9a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:59.234963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:59.236461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:59.236933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:59.239341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:59.239341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:59.243963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:59.273811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1059/2126] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:59.276067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:59.296463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116882-2d0c-436f-9a87-834fb9046097 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:59.302983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:59.303732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:59.304043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:59.304326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] PATH_INFO: `/v3/projects/5102806307b144b5843a18dfd128fa2d/users/ecc78b67da064a298014c50fd72ff796/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:59.353266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5102806307b144b5843a18dfd128fa2d, user_id=ecc78b67da064a298014c50fd72ff796, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:59.360984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:59.449905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1068/2127] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:59 2022] PUT /identity/v3/projects/5102806307b144b5843a18dfd128fa2d/users/ecc78b67da064a298014c50fd72ff796/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:59.453571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:59.468716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0c9a2-5c31-4912-a7e9-cbabe077bb88 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:59.606399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10ab9-7fc3-4dc2-bf83-b0260c5b934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:59.607272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10ab9-7fc3-4dc2-bf83-b0260c5b934e admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:59.607738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10ab9-7fc3-4dc2-bf83-b0260c5b934e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:59.608133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10ab9-7fc3-4dc2-bf83-b0260c5b934e admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:59.609129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f10ab9-7fc3-4dc2-bf83-b0260c5b934e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:59.615917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f10ab9-7fc3-4dc2-bf83-b0260c5b934e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:59.647866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1060/2128] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:59.651932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:59.673759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1882d5-1e57-4a55-8d48-39a692ba0dc6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:59.707367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:59.708364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:59.708803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:59.709229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] PATH_INFO: `/v3/projects/5102806307b144b5843a18dfd128fa2d/users/ecc78b67da064a298014c50fd72ff796/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:59.715714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5102806307b144b5843a18dfd128fa2d, user_id=ecc78b67da064a298014c50fd72ff796, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:59.719400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:59.733406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1069/2129] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:59 2022] PUT /identity/v3/projects/5102806307b144b5843a18dfd128fa2d/users/ecc78b67da064a298014c50fd72ff796/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:59.743953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:59.744548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:59.744962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:59.805983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] MFA Rules not processed for user `ecc78b67da064a298014c50fd72ff796`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:59.807467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:59.955576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1061/2130] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:55:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:59.966706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:59.969736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:00.078681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8e3e1-c0ce-4b09-ae7c-c1433f90da56 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:00.100574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4694a-0b2a-4285-ad36-666b7eebde2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:00.101619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4694a-0b2a-4285-ad36-666b7eebde2c service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:00.102013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4694a-0b2a-4285-ad36-666b7eebde2c service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:00.102414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4694a-0b2a-4285-ad36-666b7eebde2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:00.115354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4694a-0b2a-4285-ad36-666b7eebde2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:00.119706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4694a-0b2a-4285-ad36-666b7eebde2c service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:00.131855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1070/2131] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:00.404362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:00.419266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790920b3-385b-40c6-a509-5903f79b3d9e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:00.440323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:00.440323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:00.440323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:00.452288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:00.489474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:00.616377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:00.621032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:00.644849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1062/2132] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:05.346289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:05.347322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:05.347607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:05.368206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:05.369449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:05.457311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1071/2133] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 25 22:56:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:05.482475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:05.482475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:05.546919 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cedf-0a77-4a27-8afe-3e5e5d2b9548 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:05.552848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399db7b-d597-4b3a-b59c-7c695790a19b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:05.553507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399db7b-d597-4b3a-b59c-7c695790a19b service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:05.553787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399db7b-d597-4b3a-b59c-7c695790a19b service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:05.554097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399db7b-d597-4b3a-b59c-7c695790a19b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:05.565943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399db7b-d597-4b3a-b59c-7c695790a19b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:05.568143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399db7b-d597-4b3a-b59c-7c695790a19b service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:05.579839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1063/2134] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:56:08.502879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:08.581306 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:08.585965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087046a-104d-4000-802e-2e39fa9ffb4c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:08.590893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:08.591815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:08.592116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:08.592394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] PATH_INFO: `/v3/users/2ea04b530b03408198189bc54119517e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:08.593685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea04b530b03408198189bc54119517e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:08.595665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:08.845557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea04b530b03408198189bc54119517e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:08.848176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea04b530b03408198189bc54119517e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:08.859916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea04b530b03408198189bc54119517e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:08.860892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea04b530b03408198189bc54119517e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:08.882357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea04b530b03408198189bc54119517e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:09.002936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1072/2135] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:08 2022] DELETE /identity/v3/users/2ea04b530b03408198189bc54119517e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:09.003734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112ccd-5a75-4af6-adee-36845a2e1bbc None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.003734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112ccd-5a75-4af6-adee-36845a2e1bbc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.003734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112ccd-5a75-4af6-adee-36845a2e1bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.021782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a7112ccd-5a75-4af6-adee-36845a2e1bbc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:09.023096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a7112ccd-5a75-4af6-adee-36845a2e1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:09.115336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1064/2136] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:09.141534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:09.141534 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:09.219967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2bc1-f0d6-492d-a223-89230ca4bab5 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.220747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2bc1-f0d6-492d-a223-89230ca4bab5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.221337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2bc1-f0d6-492d-a223-89230ca4bab5 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.223718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1065/2137] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:56:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:09.265653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.266785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.267642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.311984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcddda-efa8-4967-b626-37e45b93421d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:09.316906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:09.317931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.318378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.318714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.340064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:09.342593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:09.342767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] MFA Rules not processed for user `c508de5b7417417da87d702090178c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:09.345444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:09.356145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1073/2138] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:09.454343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:09.472863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:09.474526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:09.499038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1066/2139] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:56:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:09.504286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4758f-15e2-47b2-8067-2d5cd197dcc5 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:09.504286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:09.504286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.504286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.505727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] PATH_INFO: `/v3/users/3a131713842d4508ba7a7b9aaddd23af` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.506492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a131713842d4508ba7a7b9aaddd23af)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:09.508776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:09.521007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:09.522715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:09.541399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607df397-bdbc-4815-9625-3d4e0f1a130c None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:09.549658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:09.550444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:09.550790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:09.551137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:09.561947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:09.563651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:09.575229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1067/2140] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:09.728056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a131713842d4508ba7a7b9aaddd23af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:09.728757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a131713842d4508ba7a7b9aaddd23af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:09.736874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a131713842d4508ba7a7b9aaddd23af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:09.737435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a131713842d4508ba7a7b9aaddd23af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:09.754809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a131713842d4508ba7a7b9aaddd23af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:09.757474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:09.860293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1074/2141] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:09 2022] DELETE /identity/v3/users/3a131713842d4508ba7a7b9aaddd23af => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:10.228589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:10.229820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:10.236600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.251419 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade66b6-7959-46bb-978b-e8134f9c2002 service placement] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:10.356014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a3d1-adfa-435f-a388-941237a8d3b8 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:10.364215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:10.365269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.365602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:10.365789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.366307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] PATH_INFO: `/v3/projects/f1fcbc0c02774283aa0e19b5059261d6` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.367032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.367455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.367958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] PATH_INFO: `/v3/projects/6dc5585d88fc4db2abb4619f8a77ca17` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.368374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fcbc0c02774283aa0e19b5059261d6)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:10.369880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc5585d88fc4db2abb4619f8a77ca17)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:10.371859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:10.376727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:10.510780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fcbc0c02774283aa0e19b5059261d6', 'request_id': 'req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.524516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fcbc0c02774283aa0e19b5059261d6', 'request_id': 'req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.537693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fcbc0c02774283aa0e19b5059261d6', 'request_id': 'req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.543337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc5585d88fc4db2abb4619f8a77ca17', 'request_id': 'req-3a8ca4a6-beae-458b-9c32-c898e559fde2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.632259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] The token cache is being invalidate because project f1fcbc0c02774283aa0e19b5059261d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:10.633129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.634240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.637445 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1075/2142] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:10 2022] DELETE /identity/v3/projects/f1fcbc0c02774283aa0e19b5059261d6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:10.642755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:10.644608 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.686469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc5585d88fc4db2abb4619f8a77ca17', 'request_id': 'req-3a8ca4a6-beae-458b-9c32-c898e559fde2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.697062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc5585d88fc4db2abb4619f8a77ca17', 'request_id': 'req-3a8ca4a6-beae-458b-9c32-c898e559fde2'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.712001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] The token cache is being invalidate because project 6dc5585d88fc4db2abb4619f8a77ca17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:10.712304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.712999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3a8ca4a6-beae-458b-9c32-c898e559fde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:10.714588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1068/2143] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:10 2022] DELETE /identity/v3/projects/6dc5585d88fc4db2abb4619f8a77ca17 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:10.722044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04468-0c18-4ef5-8895-bad087ab9b57 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.726731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04468-0c18-4ef5-8895-bad087ab9b57 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.726731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04468-0c18-4ef5-8895-bad087ab9b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.744518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-15a04468-0c18-4ef5-8895-bad087ab9b57 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:10.746799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-15a04468-0c18-4ef5-8895-bad087ab9b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.773809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d8e02-3b3c-4903-8fd7-8bdb676dd61f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:10.811096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:10.827046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:10.837055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1069/2144] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:10.851442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.851987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.852467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.860617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:10.861482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.861958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.862401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] PATH_INFO: `/v3/users/ecc78b67da064a298014c50fd72ff796` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.863701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc78b67da064a298014c50fd72ff796)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:10.865732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:10.882978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:10.885533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:10.900732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1070/2145] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:10.905930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:10.916677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34ef31-0c57-42b3-afd4-d2a5be08f119 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:10.924047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:10.924709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.925000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.925279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.926001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:56:10.926306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:10.927977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:10.942402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1071/2146] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:56:10.948072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:10.967194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe072d-d985-45cf-8619-37df477ed159 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:10.975668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:10.976606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:10.976926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:10.977466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:10.978280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:10.980464 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.080878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc78b67da064a298014c50fd72ff796'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:11.081604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc78b67da064a298014c50fd72ff796'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:11.088988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc78b67da064a298014c50fd72ff796'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:11.089727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc78b67da064a298014c50fd72ff796'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:11.103896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1072/2147] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:56:10 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:56:11.106039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc78b67da064a298014c50fd72ff796'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:11.109019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.111099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:11.207456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60743cd-0fe7-4842-9d28-86453b2639f8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.214797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.215832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.217251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.217869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.219014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.222139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.244683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1076/2148] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:10 2022] DELETE /identity/v3/users/ecc78b67da064a298014c50fd72ff796 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:56:11.339054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1073/2149] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:56:11 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:56:11.343938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.425513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2ef8f-5027-4851-b18d-aed7e2547d97 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.432312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.433134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.433532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.433909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.436269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.438487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.450157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1077/2150] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:56:11.457431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.466638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee603e-fd3e-4dd4-adf2-9670bed49237 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.471604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679f413-51a9-47b0-b88c-17ac08185d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.472280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679f413-51a9-47b0-b88c-17ac08185d44 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.472570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679f413-51a9-47b0-b88c-17ac08185d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.472853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679f413-51a9-47b0-b88c-17ac08185d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.473564 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679f413-51a9-47b0-b88c-17ac08185d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.475287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679f413-51a9-47b0-b88c-17ac08185d44 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.486734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1074/2151] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:56:11.495131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.508040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78db9-6278-4e02-968d-6d108a4208af admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.512908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.514366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.514510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.514936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] PATH_INFO: `/v3/projects/eeb432931851418abeb42d4aa180478c/users/980102349c0945febd769b943ab47fb9/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.532895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb432931851418abeb42d4aa180478c, user_id=980102349c0945febd769b943ab47fb9, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.535712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.619977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1078/2152] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:11 2022] PUT /identity/v3/projects/eeb432931851418abeb42d4aa180478c/users/980102349c0945febd769b943ab47fb9/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:56:11.635206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.635914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.636435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.676734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] MFA Rules not processed for user `980102349c0945febd769b943ab47fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:11.678582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:11.730528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.733263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:11.796417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1075/2153] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:11.804641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:11.808446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:11.810116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:11.866103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:11.884234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244b92f-271b-4d39-b183-6a3f89962521 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.886538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.887082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.887747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.888689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] PATH_INFO: `/v3/projects/5102806307b144b5843a18dfd128fa2d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.890718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5102806307b144b5843a18dfd128fa2d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.896236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.902509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d278ca1-d5f4-4b0a-84f3-421e44e74600 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:11.909400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e423d-88e0-42c4-9964-76ad92fc3311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:11.910602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e423d-88e0-42c4-9964-76ad92fc3311 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:11.910894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e423d-88e0-42c4-9964-76ad92fc3311 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:11.911178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e423d-88e0-42c4-9964-76ad92fc3311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:11.922309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e423d-88e0-42c4-9964-76ad92fc3311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:11.923827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e423d-88e0-42c4-9964-76ad92fc3311 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:11.933849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1076/2154] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:56:12.038435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5102806307b144b5843a18dfd128fa2d', 'request_id': 'req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:12.047931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5102806307b144b5843a18dfd128fa2d', 'request_id': 'req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:12.056050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5102806307b144b5843a18dfd128fa2d', 'request_id': 'req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:12.163188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] The token cache is being invalidate because project 5102806307b144b5843a18dfd128fa2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:12.163451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:12.164254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98eb4d4d-f3df-4cf9-92f9-0c487e159a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:12.166792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1079/2155] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:11 2022] DELETE /identity/v3/projects/5102806307b144b5843a18dfd128fa2d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:12.172793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.173290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.173775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.205083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:12.205998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:12.270026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1077/2156] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:12.284182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.284182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.284182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.303465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:12.304734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:12.313712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1080/2157] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:12.318173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:12.328864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b8b6-564c-47d5-abb0-e47f4e5e1ee5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.333626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.334245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.334528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.334832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.335598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:56:12.335872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.337501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.353044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1078/2158] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:56:12.358956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:12.371385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3c3a-fdcf-4fbd-b6d3-e4940badbc5b None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.376923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.377550 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.377836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.378117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.378794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.381025 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.471311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1081/2159] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:56:12 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:56:12.475748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:12.486551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a90b8-0d80-4f01-85af-dec73af002e5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.558267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.558974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.559265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.559786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.560472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.562707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.658870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1079/2160] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:56:12 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:56:12.663110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:12.674885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701abe-f954-488d-9ccb-936ba9781a44 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.679992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.680643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.687502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.687502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.687502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.687502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.699662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1082/2161] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:56:12.704930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:12.720710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40186b6-b7c0-4b5c-a653-af05594cc897 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.731125 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed16437-5d7d-4fc4-bfb9-f3d6a999904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.732345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed16437-5d7d-4fc4-bfb9-f3d6a999904f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.732846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed16437-5d7d-4fc4-bfb9-f3d6a999904f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.733330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed16437-5d7d-4fc4-bfb9-f3d6a999904f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.734744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed16437-5d7d-4fc4-bfb9-f3d6a999904f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.737823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed16437-5d7d-4fc4-bfb9-f3d6a999904f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.767944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1080/2162] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:12.773230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:12.793032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23622e4-cdf2-4c69-97d5-adbc09485a46 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:12.798857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:12.799693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.800124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.800486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] PATH_INFO: `/v3/projects/4711c625c8474bbb86453e9b7295a252/users/06568a9ad4a341ca9a2ac04aeb84b214/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.818630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4711c625c8474bbb86453e9b7295a252, user_id=06568a9ad4a341ca9a2ac04aeb84b214, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:12.822053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:12.931087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1083/2163] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:12 2022] PUT /identity/v3/projects/4711c625c8474bbb86453e9b7295a252/users/06568a9ad4a341ca9a2ac04aeb84b214/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:12.944146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:12.945602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:12.945602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:12.979567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] MFA Rules not processed for user `06568a9ad4a341ca9a2ac04aeb84b214`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:12.981024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:13.019007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:13.080243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1081/2164] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:13.082247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.150207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:13.182479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2eae2-6cc1-49ec-ba84-8caccba00d70 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.187868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.189492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.189726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.190013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.190722 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.193457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.315368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1084/2165] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:56:13 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:56:13.320132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.334758 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226cdec-194f-4804-904a-ebda3b4f4654 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.415649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.416593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.416593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.416922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.417531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.420044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.530211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1082/2166] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:56:13 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:56:13.534749 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.547461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd774a-bfa8-49f7-8840-d604012b404b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.554003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.555057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.555574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.556900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.557572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.559467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.575109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1085/2167] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:56:13.579937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.590706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9996-2e11-40c8-a854-cc6e12895af4 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.596691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.597388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.597670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.598378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] PATH_INFO: `/v3/projects/3dad6e2080fa437290e89eac0de5bb7f/users/471b009a04324e05afec15b6ae33583d/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.617241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dad6e2080fa437290e89eac0de5bb7f, user_id=471b009a04324e05afec15b6ae33583d, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.620010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.729777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1083/2168] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:13 2022] PUT /identity/v3/projects/3dad6e2080fa437290e89eac0de5bb7f/users/471b009a04324e05afec15b6ae33583d/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:13.734093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.748221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644a83-3ebf-4eea-ad4e-35e9f1fff4d1 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.833509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db3ed7-09ff-495e-92cf-208c311ba64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.836439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db3ed7-09ff-495e-92cf-208c311ba64c admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.836794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db3ed7-09ff-495e-92cf-208c311ba64c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.837226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db3ed7-09ff-495e-92cf-208c311ba64c admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.837844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db3ed7-09ff-495e-92cf-208c311ba64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.839521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db3ed7-09ff-495e-92cf-208c311ba64c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.854053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1086/2169] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:13.856912 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.869371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ee672-299e-4dcd-9a18-07cc0066abd5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.877535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.878231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.878665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.878952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] PATH_INFO: `/v3/projects/3dad6e2080fa437290e89eac0de5bb7f/users/471b009a04324e05afec15b6ae33583d/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.881522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dad6e2080fa437290e89eac0de5bb7f, user_id=471b009a04324e05afec15b6ae33583d, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.884230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.902463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1084/2170] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:13 2022] PUT /identity/v3/projects/3dad6e2080fa437290e89eac0de5bb7f/users/471b009a04324e05afec15b6ae33583d/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:13.915876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.915876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.917034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.955285 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] MFA Rules not processed for user `471b009a04324e05afec15b6ae33583d`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:13.956585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:14.042752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1087/2171] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:14.055304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:14.057232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:14.134984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a0ac-eeb7-42e1-b33e-63c6ddafb286 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:14.140685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:14.141342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:14.141626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:14.141910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:14.159296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:14.161915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:14.180816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1085/2172] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:14.989483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:15.052414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:15.074101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d0870-6cbe-45a5-84a1-3b17d3056d2d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:15.079611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:15.080419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.080708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.081076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] PATH_INFO: `/v3/users/06568a9ad4a341ca9a2ac04aeb84b214` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.082251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06568a9ad4a341ca9a2ac04aeb84b214)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:15.084250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:15.313440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06568a9ad4a341ca9a2ac04aeb84b214'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.314577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06568a9ad4a341ca9a2ac04aeb84b214'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.325079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:15.326797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.332033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06568a9ad4a341ca9a2ac04aeb84b214'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.334701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06568a9ad4a341ca9a2ac04aeb84b214'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.343352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d258-bcf4-47bd-9a2e-b94e8061fcc0 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:15.351468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:15.352511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.353039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.353536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] PATH_INFO: `/v3/users/980102349c0945febd769b943ab47fb9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.355315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980102349c0945febd769b943ab47fb9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:15.359447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:15.366711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e64a03b9-a995-40ba-ad28-d787fa5b3d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06568a9ad4a341ca9a2ac04aeb84b214'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.381967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:15.481554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1088/2173] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:14 2022] DELETE /identity/v3/users/06568a9ad4a341ca9a2ac04aeb84b214 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:15.488143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.488654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.489147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.520431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:15.521733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.581745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980102349c0945febd769b943ab47fb9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.583668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980102349c0945febd769b943ab47fb9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.633358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1089/2174] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:15.646073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:15.648328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.689015 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980102349c0945febd769b943ab47fb9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.690154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980102349c0945febd769b943ab47fb9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.729011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c38b7b4f-55a2-4c1f-853d-6417266aefa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980102349c0945febd769b943ab47fb9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:15.765465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1086/2175] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:15 2022] DELETE /identity/v3/users/980102349c0945febd769b943ab47fb9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:15.770830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.770830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.771366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.776323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bab7d-c5bd-4c78-9582-25b8c19a8ae9 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:15.810559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:15.833246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:15.835747 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.884224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:15.885688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.885688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.885688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.888322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.951287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1087/2176] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:15.963197 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:15.964933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:15.979893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c103-bdd5-47ec-827e-8302b42ede74 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:15.985160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:15.985905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:15.986193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:15.986476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:15.991032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:15.992544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:15.997253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:15.998749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:16.003736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1090/2177] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:16.011562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1088/2178] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:56:16.601046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:16.602607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:16.624937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c67d-c113-4c09-81ba-cb270cc2fc0a service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:16.630015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:16.631374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:16.631833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:16.632313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] PATH_INFO: `/v3/projects/eeb432931851418abeb42d4aa180478c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:16.633948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb432931851418abeb42d4aa180478c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:16.636302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:16.706949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:16.708553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:16.727332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459f3b-65d0-4417-88e0-28f58615c579 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:16.734324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:16.735037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:16.735648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:16.735648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] PATH_INFO: `/v3/projects/4711c625c8474bbb86453e9b7295a252` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:16.737090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4711c625c8474bbb86453e9b7295a252)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:16.739200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:16.767136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb432931851418abeb42d4aa180478c', 'request_id': 'req-882940a5-7e56-438d-bfc8-9cea4c27efb2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:16.774693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb432931851418abeb42d4aa180478c', 'request_id': 'req-882940a5-7e56-438d-bfc8-9cea4c27efb2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:16.781421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb432931851418abeb42d4aa180478c', 'request_id': 'req-882940a5-7e56-438d-bfc8-9cea4c27efb2'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:16.876421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] The token cache is being invalidate because project eeb432931851418abeb42d4aa180478c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:16.876827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:16.877857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-882940a5-7e56-438d-bfc8-9cea4c27efb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:16.884588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1091/2179] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:16 2022] DELETE /identity/v3/projects/eeb432931851418abeb42d4aa180478c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:16.886483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093f647-a9ef-4bf1-a940-82cf60d95723 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:16.886773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093f647-a9ef-4bf1-a940-82cf60d95723 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:16.887058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093f647-a9ef-4bf1-a940-82cf60d95723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:16.897937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4711c625c8474bbb86453e9b7295a252', 'request_id': 'req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:16.913290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-7093f647-a9ef-4bf1-a940-82cf60d95723 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:16.914789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7093f647-a9ef-4bf1-a940-82cf60d95723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:16.979363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:16.998457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1092/2180] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:17.008134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:17.008494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:17.008890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:17.014329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4711c625c8474bbb86453e9b7295a252', 'request_id': 'req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.024364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4711c625c8474bbb86453e9b7295a252', 'request_id': 'req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.040053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:17.042476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:17.045683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] The token cache is being invalidate because project 4711c625c8474bbb86453e9b7295a252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:17.046481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.047365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.049989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1089/2181] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:16 2022] DELETE /identity/v3/projects/4711c625c8474bbb86453e9b7295a252 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:17.054424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:17.055174 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1093/2182] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:17.059356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:17.059552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:17.068740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:17.072079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd9cf-c38c-4fa9-8efc-3350355fc76d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:17.077170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77764f11-3b2d-49ad-8baa-e2cc2b882e4d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:17.078311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:17.078950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:17.079233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:17.079515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:17.080413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:56:17.080632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:17.082233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:17.085336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:17.086466 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:17.086971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:17.087476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] PATH_INFO: `/v3/users/471b009a04324e05afec15b6ae33583d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:17.089636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471b009a04324e05afec15b6ae33583d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:17.094316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:17.096653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1094/2183] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:56:17.103409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:17.121071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed43c4-03c9-44bf-a7ab-cf3e315f67c6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:17.128908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:17.129498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:17.129904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:17.130230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:17.131649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:17.133838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:17.272627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1095/2184] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:56:17 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:56:17.276994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:17.351875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471b009a04324e05afec15b6ae33583d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.352799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471b009a04324e05afec15b6ae33583d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.375651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299877e8-b8ce-48a1-b77c-afb874e1db99 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:17.381040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:17.381617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:17.381907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:17.382186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:17.383024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:17.385022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:17.768284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471b009a04324e05afec15b6ae33583d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.793728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471b009a04324e05afec15b6ae33583d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.793728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471b009a04324e05afec15b6ae33583d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:17.799205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1090/2185] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:17 2022] DELETE /identity/v3/users/471b009a04324e05afec15b6ae33583d => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:17.888847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1096/2186] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:56:17 2022] POST /identity/v3/users => generated 288 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:56:17.890160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:17.891630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:17.969647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba864-dcdb-4aba-895d-53d39df04002 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:17.974620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:17.975256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:17.975611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:17.975854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:17.976688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:17.978271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:17.990032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1091/2187] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:17.994238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:18.005655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37f0ec-d0e2-4d31-80ab-29640c78a2b9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:18.020595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c46f7-9e55-4519-b8b8-da91c8b8712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:18.021523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c46f7-9e55-4519-b8b8-da91c8b8712d admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.021979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c46f7-9e55-4519-b8b8-da91c8b8712d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.022452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c46f7-9e55-4519-b8b8-da91c8b8712d admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.023334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c46f7-9e55-4519-b8b8-da91c8b8712d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:18.025586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c46f7-9e55-4519-b8b8-da91c8b8712d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:18.038658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1097/2188] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:18.043917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:18.059375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28bc66-f730-4664-a94b-93a3e537e02d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:18.071255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:18.072649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.073339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.074253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] PATH_INFO: `/v3/projects/a08c57e58ff0421b86413be4fe067b02/users/f00dd1660c054b55b2136216846bbd0b/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.102089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08c57e58ff0421b86413be4fe067b02, user_id=f00dd1660c054b55b2136216846bbd0b, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:18.105407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:18.233085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1092/2189] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:18 2022] PUT /identity/v3/projects/a08c57e58ff0421b86413be4fe067b02/users/f00dd1660c054b55b2136216846bbd0b/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:56:18.244780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.245187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.245519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.310894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] MFA Rules not processed for user `f00dd1660c054b55b2136216846bbd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:18.312977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:18.334600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:18.337959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:18.437773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1098/2190] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:18.456079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:18.457710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:18.470759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:18.483889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:18.495613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0df87-84a2-45cb-b077-1b6663956a79 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:18.508585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:18.510285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.510578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.510871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] PATH_INFO: `/v3/projects/3dad6e2080fa437290e89eac0de5bb7f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.512328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dad6e2080fa437290e89eac0de5bb7f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:18.514575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:18.545586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8def49-d198-4ebb-aea3-faae7a502fab None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:18.550101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d48f6-c537-458f-83d0-baaf7f0e772c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:18.550735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d48f6-c537-458f-83d0-baaf7f0e772c service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.551028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d48f6-c537-458f-83d0-baaf7f0e772c service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.551302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d48f6-c537-458f-83d0-baaf7f0e772c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.561653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d48f6-c537-458f-83d0-baaf7f0e772c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:18.563114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d48f6-c537-458f-83d0-baaf7f0e772c service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:18.573359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1099/2191] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:56:18.652157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dad6e2080fa437290e89eac0de5bb7f', 'request_id': 'req-bf157f9c-ad77-46a7-a268-3dc23e5de55d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:18.785227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dad6e2080fa437290e89eac0de5bb7f', 'request_id': 'req-bf157f9c-ad77-46a7-a268-3dc23e5de55d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:18.792850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dad6e2080fa437290e89eac0de5bb7f', 'request_id': 'req-bf157f9c-ad77-46a7-a268-3dc23e5de55d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:18.807314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] The token cache is being invalidate because project 3dad6e2080fa437290e89eac0de5bb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:18.807635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:18.808325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-bf157f9c-ad77-46a7-a268-3dc23e5de55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:18.810575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1093/2192] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:18 2022] DELETE /identity/v3/projects/3dad6e2080fa437290e89eac0de5bb7f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:18.815456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:18.815922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:18.816305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:18.840653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:18.842580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:18.927022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1100/2193] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:19.009383 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.009904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.010403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.043975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:19.046569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:19.060316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1094/2194] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:19.066300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.084262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ebf11-f2ad-44c2-b92b-3fa3f387d642 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.096417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.098900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.098900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.099268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.100310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:56:19.100718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.103542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.126266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1101/2195] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:56:19.127964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.143216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77c5f1-9ece-40e8-af1a-d461c948bc4e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.151493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.152655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.153152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.154404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.155811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.157929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.298110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1095/2196] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:56:19 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:56:19.304834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.321850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b314-1e1d-4db2-862c-57d2a02b1c35 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.408071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.408833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.409310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.409691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.410989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.413625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.535699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1102/2197] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:56:19 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:56:19.543625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.562285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac748e47-fdf7-475f-86fb-455c06009e64 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.568153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.569406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.569406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.569641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.570604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.572847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.587282 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1096/2198] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:19.592419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.603271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7e7c-230c-45d6-8307-e8a0b3330bd6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.610221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190892f6-96e5-4c4f-bc1a-ca86ab2cdbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.618511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190892f6-96e5-4c4f-bc1a-ca86ab2cdbed admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.618511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190892f6-96e5-4c4f-bc1a-ca86ab2cdbed admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.618511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190892f6-96e5-4c4f-bc1a-ca86ab2cdbed admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.618511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190892f6-96e5-4c4f-bc1a-ca86ab2cdbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.618511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190892f6-96e5-4c4f-bc1a-ca86ab2cdbed admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.627391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1103/2199] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:19.632063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.644942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968787-9253-40c2-92ba-c5f11d8c463a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.649802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.650485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.650773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.651055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] PATH_INFO: `/v3/projects/695911a335d1454ab3f7e1fdf700a4cc/users/dac5117b95ce4887a97bead7608d5355/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.667569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695911a335d1454ab3f7e1fdf700a4cc, user_id=dac5117b95ce4887a97bead7608d5355, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.670331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.758556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1097/2200] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:19 2022] PUT /identity/v3/projects/695911a335d1454ab3f7e1fdf700a4cc/users/dac5117b95ce4887a97bead7608d5355/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:19.765200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3465a5-bb36-416a-9c88-998609f9ff20 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.765419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3465a5-bb36-416a-9c88-998609f9ff20 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.765735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3465a5-bb36-416a-9c88-998609f9ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.785702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0a3465a5-bb36-416a-9c88-998609f9ff20 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:19.786990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0a3465a5-bb36-416a-9c88-998609f9ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:19.808811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:19.855462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1104/2201] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:19.866306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:19.868426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:19.929275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6eadd-43b5-4501-bf1c-131ced56c3b4 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:19.933298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:19.933924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:19.934215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:19.934498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:19.945061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:19.946597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:19.957741 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1098/2202] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:26.834651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:26.835432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:26.835593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:26.905342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] MFA Rules not processed for user `dac5117b95ce4887a97bead7608d5355`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:26.906920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:27.051476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1105/2203] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:27.056629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:27.067749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dde6-aaed-40de-9f4b-ccf647cf9dc4 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:27.074577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:27.076245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.076617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.077139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.077903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:27.080305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:27.104505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:27.207343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1099/2204] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:56:27 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:56:27.212173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:27.224105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e1a08-ccca-40ac-a487-fa872d635677 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:27.333249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:27.334054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.334449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.334830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.335622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:27.337703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:27.423420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1106/2205] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:56:27 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:56:27.427181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:27.448686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc53e93-de0c-4291-aac0-e0f2998b9153 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:27.461661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:27.462384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.462672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.462953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.463660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:27.465318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:27.480638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1100/2206] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:56:27.485961 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:27.508856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc765fd-0cfc-4214-9f71-bf115892e7ab admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:27.516024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:27.519295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.519295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.519295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] PATH_INFO: `/v3/projects/e7c78cc4ecb9457f9ef99acc23c60926/users/8907e090ba444714a606620fc48313a1/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.543334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c78cc4ecb9457f9ef99acc23c60926, user_id=8907e090ba444714a606620fc48313a1, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:27.546930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:27.623146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1107/2207] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:27 2022] PUT /identity/v3/projects/e7c78cc4ecb9457f9ef99acc23c60926/users/8907e090ba444714a606620fc48313a1/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:27.627703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:27.640678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc1425-c8f7-4da0-9dc4-26d5ec919951 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:27.712683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:27.713770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.714164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.715089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.715721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:27.718266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:27.731811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1101/2208] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:56:27.736038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:27.747643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e5be4-bfc7-4393-b77c-7b2c0a927b29 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:27.754621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84fbba-d50f-4dfd-acac-fc0d55fe99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:27.755414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fbba-d50f-4dfd-acac-fc0d55fe99d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:27.756061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fbba-d50f-4dfd-acac-fc0d55fe99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:27.756351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fbba-d50f-4dfd-acac-fc0d55fe99d0 admin admin] PATH_INFO: `/v3/projects/e7c78cc4ecb9457f9ef99acc23c60926/users/8907e090ba444714a606620fc48313a1/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:27.758443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84fbba-d50f-4dfd-acac-fc0d55fe99d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c78cc4ecb9457f9ef99acc23c60926, user_id=8907e090ba444714a606620fc48313a1, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:27.761280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84fbba-d50f-4dfd-acac-fc0d55fe99d0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:27.775298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1108/2209] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:56:27 2022] PUT /identity/v3/projects/e7c78cc4ecb9457f9ef99acc23c60926/users/8907e090ba444714a606620fc48313a1/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:31.963936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:31.967215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:31.990221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4946-74e6-480d-9a62-41d16e102644 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:32.122676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:32.123640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:32.124160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:32.124666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] PATH_INFO: `/v3/users/f00dd1660c054b55b2136216846bbd0b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:32.126817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00dd1660c054b55b2136216846bbd0b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:32.129818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:32.432990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00dd1660c054b55b2136216846bbd0b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:32.433806 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00dd1660c054b55b2136216846bbd0b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:32.537323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00dd1660c054b55b2136216846bbd0b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:32.538079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00dd1660c054b55b2136216846bbd0b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:32.555370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00dd1660c054b55b2136216846bbd0b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:32.567542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:32.572552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1102/2210] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:56:31 2022] DELETE /identity/v3/users/f00dd1660c054b55b2136216846bbd0b => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:32.577714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:32.578257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:32.578362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:32.599597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:32.600956 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:32.605409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:32.667878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1109/2211] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:32.677798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:32.679231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:32.764227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fabb9-ff45-429f-8bc9-b1156ffb9a0d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:32.776323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37841bee-595d-4c69-aada-11d2d4fbc4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:32.777516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37841bee-595d-4c69-aada-11d2d4fbc4de service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:32.779025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37841bee-595d-4c69-aada-11d2d4fbc4de service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:32.779025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37841bee-595d-4c69-aada-11d2d4fbc4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:32.790663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37841bee-595d-4c69-aada-11d2d4fbc4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:32.792220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37841bee-595d-4c69-aada-11d2d4fbc4de service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:32.804115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1103/2212] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:33.524872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:33.526943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:33.590403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f6190-0567-4ca0-bdea-c22efe19c5fc None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:33.618701 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:33.619639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:33.620085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:33.620433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] PATH_INFO: `/v3/projects/a08c57e58ff0421b86413be4fe067b02` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:33.621759 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08c57e58ff0421b86413be4fe067b02)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:33.624959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:33.758458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08c57e58ff0421b86413be4fe067b02', 'request_id': 'req-c46bccce-cc69-4b37-a3c6-160ece17e40f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:33.766533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08c57e58ff0421b86413be4fe067b02', 'request_id': 'req-c46bccce-cc69-4b37-a3c6-160ece17e40f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:33.775625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08c57e58ff0421b86413be4fe067b02', 'request_id': 'req-c46bccce-cc69-4b37-a3c6-160ece17e40f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:33.841571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] The token cache is being invalidate because project a08c57e58ff0421b86413be4fe067b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:56:33.841929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:33.842576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:56:33.844289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1110/2213] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:56:33 2022] DELETE /identity/v3/projects/a08c57e58ff0421b86413be4fe067b02 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:35.654580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec8f19-058b-4881-941c-44a8338ff3ef None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:35.655634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec8f19-058b-4881-941c-44a8338ff3ef None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:35.656555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec8f19-058b-4881-941c-44a8338ff3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:35.693246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cdec8f19-058b-4881-941c-44a8338ff3ef None None] MFA Rules not processed for user `8907e090ba444714a606620fc48313a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:35.694836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cdec8f19-058b-4881-941c-44a8338ff3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:35.821579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1104/2214] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:35.837777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:35.839571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:35.955521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bccce-cc69-4b37-a3c6-160ece17e40f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:35.959347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:35.960026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:35.960313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:35.960592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:35.962447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:35.998455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:36.046508 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:36.048842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:36.063075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1111/2215] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:36.552136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:36.552483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:36.552712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:36.574956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:36.577068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:36.642837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1105/2216] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:56:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:36.676935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:36.678593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:36.761268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49071-dd4a-4096-b4f3-208fb1cad229 service glance] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:36.768289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8d2d1-99a7-4d4f-b529-dd4dc98bb321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:36.768947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8d2d1-99a7-4d4f-b529-dd4dc98bb321 service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:36.769234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8d2d1-99a7-4d4f-b529-dd4dc98bb321 service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:36.769510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8d2d1-99a7-4d4f-b529-dd4dc98bb321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:36.779040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8d2d1-99a7-4d4f-b529-dd4dc98bb321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:36.780790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8d2d1-99a7-4d4f-b529-dd4dc98bb321 service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:36.790143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1112/2217] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:56:40.729933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:40.733264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:40.841318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:40.847249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27092bff-f328-4f83-9074-4ed1a44214ad None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:40.854064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:40.854921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:40.855163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:40.855495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:40.857994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:40.871380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:40.873730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:40.891628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1106/2218] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:43.358230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b61295-d715-46b8-9e5c-837fe7be0c92 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:43.359337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b61295-d715-46b8-9e5c-837fe7be0c92 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:43.359634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b61295-d715-46b8-9e5c-837fe7be0c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:43.389676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-46b61295-d715-46b8-9e5c-837fe7be0c92 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:43.393674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-46b61295-d715-46b8-9e5c-837fe7be0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:43.527130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1113/2219] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:43.565316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:43.567652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:43.707673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8717a-b3bb-4fb4-889f-a5cb43542920 service placement] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:43.716947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:43.717626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:43.717937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:43.718226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:43.736214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:43.741112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:43.759992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1107/2220] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:45.094950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf521-3503-4876-aeaf-abe943574e10 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:45.095632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf521-3503-4876-aeaf-abe943574e10 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:45.095632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf521-3503-4876-aeaf-abe943574e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:45.120781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-67ebf521-3503-4876-aeaf-abe943574e10 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:45.122863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-67ebf521-3503-4876-aeaf-abe943574e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:45.135868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1114/2221] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:56:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:45.151358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:45.166094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25c10-3c84-42ca-8589-1f929cc8ea9a service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:45.174753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:45.175903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:45.176434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:45.176939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:45.228899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:45.231668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:45.250176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1108/2222] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 22:56:49.588461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9944e-da20-4394-b7dc-afd6304ffa4e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:49.589353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9944e-da20-4394-b7dc-afd6304ffa4e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:49.589353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9944e-da20-4394-b7dc-afd6304ffa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:49.627406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-95b9944e-da20-4394-b7dc-afd6304ffa4e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:49.629505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-95b9944e-da20-4394-b7dc-afd6304ffa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:49.641028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1115/2223] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:49.668086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:49.670275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:49.691870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62af4a-8f80-4836-b441-bbf7e00a6380 service swift] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:49.704478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923f95-eab8-4062-b667-3b81b427a1e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:49.706298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923f95-eab8-4062-b667-3b81b427a1e6 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:49.708200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923f95-eab8-4062-b667-3b81b427a1e6 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:49.708854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923f95-eab8-4062-b667-3b81b427a1e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:49.760915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923f95-eab8-4062-b667-3b81b427a1e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:49.764006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923f95-eab8-4062-b667-3b81b427a1e6 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:49.789408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1109/2224] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:50.834261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:50.834851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:50.834957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:50.859430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] MFA Rules not processed for user `dac5117b95ce4887a97bead7608d5355`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:50.861205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:50.870917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1116/2225] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:56:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:56.290183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b557-8fc9-447d-9260-7a51dce01bdb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:56.290723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b557-8fc9-447d-9260-7a51dce01bdb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:56.290942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b557-8fc9-447d-9260-7a51dce01bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:56.338144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-de57b557-8fc9-447d-9260-7a51dce01bdb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:56.340588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-de57b557-8fc9-447d-9260-7a51dce01bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:56.365490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1110/2226] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:56.530799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:56.558653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c20d2-c5ff-426e-b430-c09cddf8a007 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:56.574121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:56.576866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:56.577429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:56.578411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:56.613931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:56.619599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:56.673415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1117/2227] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:56.789296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aa6e-a41a-478e-a81e-0e51cf3db6b2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:56.789759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aa6e-a41a-478e-a81e-0e51cf3db6b2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:56.790180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aa6e-a41a-478e-a81e-0e51cf3db6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:56.822274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-20c4aa6e-a41a-478e-a81e-0e51cf3db6b2 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:56.827524 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-20c4aa6e-a41a-478e-a81e-0e51cf3db6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:56.845286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1111/2228] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:56.875739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:56.895077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b874ed-e5fa-4deb-88b4-5b9c9717e94e service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:56.911405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:56.912467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:56.912951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:56.913383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:56.998502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:57.002348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:57.110887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1118/2229] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:57:06.807933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=70 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:07.072643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:10.558593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daf101-81b4-4646-bb15-1c23bdb01857 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:10.559481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daf101-81b4-4646-bb15-1c23bdb01857 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:10.559725 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daf101-81b4-4646-bb15-1c23bdb01857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:10.580873 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-54daf101-81b4-4646-bb15-1c23bdb01857 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:10.582151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-54daf101-81b4-4646-bb15-1c23bdb01857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:10.591103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1112/2230] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:10.606721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:10.619155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea3df-8d07-46f3-815d-2019f66d72ed service swift] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:10.625325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:10.625950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:10.626238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:10.626514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:10.635538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:10.637788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:10.647774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1119/2231] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:15.874567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b18d3-ca7a-4ba1-b9eb-ee076fdc16cc None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:15.875141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b18d3-ca7a-4ba1-b9eb-ee076fdc16cc None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:15.875261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b18d3-ca7a-4ba1-b9eb-ee076fdc16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:15.895345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-663b18d3-ca7a-4ba1-b9eb-ee076fdc16cc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:15.896611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-663b18d3-ca7a-4ba1-b9eb-ee076fdc16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:15.905308 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1113/2232] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:15.930466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:15.943546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4401889-151c-48df-9ea3-7417f55515c5 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:15.949210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a430be-4b6d-4437-827c-dfee03234ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:15.949831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a430be-4b6d-4437-827c-dfee03234ee7 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:15.950138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a430be-4b6d-4437-827c-dfee03234ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:15.950402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a430be-4b6d-4437-827c-dfee03234ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:15.959459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a430be-4b6d-4437-827c-dfee03234ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:15.961079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a430be-4b6d-4437-827c-dfee03234ee7 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:15.973250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1120/2233] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:57:18.981212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cc4bf-666c-42c7-ac0f-1e58861adb1b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:18.981758 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cc4bf-666c-42c7-ac0f-1e58861adb1b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:18.981942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cc4bf-666c-42c7-ac0f-1e58861adb1b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:18.983391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1114/2234] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:57:18.989817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47490c-89a2-46df-b2be-c8df2fc9fba4 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:18.990331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47490c-89a2-46df-b2be-c8df2fc9fba4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:18.990442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47490c-89a2-46df-b2be-c8df2fc9fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.012470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ef47490c-89a2-46df-b2be-c8df2fc9fba4 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:19.014037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ef47490c-89a2-46df-b2be-c8df2fc9fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:19.025451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1121/2235] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:57:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:19.038424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cc4bf-666c-42c7-ac0f-1e58861adb1b None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:19.052345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cc4bf-666c-42c7-ac0f-1e58861adb1b None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:19.056204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d787-b5b4-48fa-b326-3b41adadfb81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:19.056857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d787-b5b4-48fa-b326-3b41adadfb81 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.057143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d787-b5b4-48fa-b326-3b41adadfb81 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.057456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d787-b5b4-48fa-b326-3b41adadfb81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.068819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6d787-b5b4-48fa-b326-3b41adadfb81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:19.070365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6d787-b5b4-48fa-b326-3b41adadfb81 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:19.082215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1115/2236] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:19.337519 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4431ce-377e-4419-b0f2-dad5840b34a0 None None] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.337910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4431ce-377e-4419-b0f2-dad5840b34a0 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.338289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4431ce-377e-4419-b0f2-dad5840b34a0 None None] PATH_INFO: `/` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.344684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1122/2237] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:19.345783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc78fb-1da3-4ee9-b407-bb3fe2331756 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.346072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc78fb-1da3-4ee9-b407-bb3fe2331756 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.346353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc78fb-1da3-4ee9-b407-bb3fe2331756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.366102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-aebc78fb-1da3-4ee9-b407-bb3fe2331756 None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:19.367332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aebc78fb-1da3-4ee9-b407-bb3fe2331756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:19.422184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1116/2238] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:57:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:19.434297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4431ce-377e-4419-b0f2-dad5840b34a0 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:19.436075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2f4431ce-377e-4419-b0f2-dad5840b34a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:19.450032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4431ce-377e-4419-b0f2-dad5840b34a0 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:19.454206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d5c31-1417-45ed-a1d8-2be667922765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:19.454839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d5c31-1417-45ed-a1d8-2be667922765 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.455336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d5c31-1417-45ed-a1d8-2be667922765 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.455618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d5c31-1417-45ed-a1d8-2be667922765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.464470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d5c31-1417-45ed-a1d8-2be667922765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:19.466545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d5c31-1417-45ed-a1d8-2be667922765 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:19.476527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1123/2239] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:19.592744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e496-1b44-4063-b427-2f8a699379bd None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.593032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e496-1b44-4063-b427-2f8a699379bd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.593540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e496-1b44-4063-b427-2f8a699379bd None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.595700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1117/2240] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 22:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:19.601799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ead0e-5307-4e61-8b57-c964285c633d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.602169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ead0e-5307-4e61-8b57-c964285c633d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.602514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ead0e-5307-4e61-8b57-c964285c633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.630566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ec8ead0e-5307-4e61-8b57-c964285c633d None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:19.631911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ec8ead0e-5307-4e61-8b57-c964285c633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:19.642645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1124/2241] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 22:57:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:19.654053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e496-1b44-4063-b427-2f8a699379bd None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:19.665687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e496-1b44-4063-b427-2f8a699379bd None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:19.669427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:19.670061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:19.671775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:19.671775 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:19.681754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:19.683832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:19.701190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1118/2242] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:22.280831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04595ca-0afe-4e0a-9070-805e748dbfc5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:22.281368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04595ca-0afe-4e0a-9070-805e748dbfc5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:22.281501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04595ca-0afe-4e0a-9070-805e748dbfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:22.306900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e04595ca-0afe-4e0a-9070-805e748dbfc5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:22.308362 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e04595ca-0afe-4e0a-9070-805e748dbfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:22.318484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1125/2243] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:57:22.332100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:22.344662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba423c75-751a-4c7b-9d75-6e9b9a104c45 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:22.351226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:22.351872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:22.352155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:22.352411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:22.361826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:22.363643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:22.374683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1119/2244] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:26.488200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e2b1b-a423-4791-87dd-cad9818d7e64 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:26.488965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e2b1b-a423-4791-87dd-cad9818d7e64 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:26.488965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e2b1b-a423-4791-87dd-cad9818d7e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:26.509408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-874e2b1b-a423-4791-87dd-cad9818d7e64 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:26.510777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-874e2b1b-a423-4791-87dd-cad9818d7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:26.526463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1126/2245] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:26.539048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:26.551352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6108a82-5378-4be4-99ee-fcc01c2fd7a3 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:26.556384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc885e2-39fa-401b-b50f-14264a3e3696 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:26.556989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc885e2-39fa-401b-b50f-14264a3e3696 service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:26.557279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc885e2-39fa-401b-b50f-14264a3e3696 service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:26.557554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc885e2-39fa-401b-b50f-14264a3e3696 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:26.566958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc885e2-39fa-401b-b50f-14264a3e3696 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:26.568579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc885e2-39fa-401b-b50f-14264a3e3696 service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:26.578732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1120/2246] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:57:31.553695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:31.554343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:31.554343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:31.576607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] MFA Rules not processed for user `7f54b07b4dbc4e67b44a1c3ff6d60226`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:31.577864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:31.653826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1127/2247] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:36.573978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=53 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:41.565203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f1d1-427b-4519-9236-3415ff225a06 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:41.565203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f1d1-427b-4519-9236-3415ff225a06 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:41.565203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f1d1-427b-4519-9236-3415ff225a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:41.611735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-14e0f1d1-427b-4519-9236-3415ff225a06 None None] MFA Rules not processed for user `0940cde66b1247b89a34b60a3dbe3452`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:41.614331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-14e0f1d1-427b-4519-9236-3415ff225a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:41.646507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=55 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:41.755179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1121/2248] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:57:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:57:48.482079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:48.482079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:48.493573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c069cb-35d2-4b0b-a644-4f8b368803f6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:48.498308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:48.498945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:48.499244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:48.499566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:48.510109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:48.512687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:48.524791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1128/2249] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:50.933660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c313-5919-4769-a271-921bf941ace3 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:50.933660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c313-5919-4769-a271-921bf941ace3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:50.933660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c313-5919-4769-a271-921bf941ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:50.976548 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-aca8c313-5919-4769-a271-921bf941ace3 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:50.978195 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-aca8c313-5919-4769-a271-921bf941ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:51.003028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1122/2250] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 25 22:57:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:51.027014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:51.040504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823232f-3c58-4b3e-8fe5-bbbef0444777 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:51.047459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4438a-fc4f-4d69-a4c1-9415e6ecb973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:51.048411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4438a-fc4f-4d69-a4c1-9415e6ecb973 service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:51.048767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4438a-fc4f-4d69-a4c1-9415e6ecb973 service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:51.049111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4438a-fc4f-4d69-a4c1-9415e6ecb973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:51.058439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4438a-fc4f-4d69-a4c1-9415e6ecb973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:51.060064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4438a-fc4f-4d69-a4c1-9415e6ecb973 service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:51.068772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1129/2251] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:57:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:57:56.905228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b11e-95ec-4c74-81ee-5327fbf99826 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:56.905826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b11e-95ec-4c74-81ee-5327fbf99826 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:56.905826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b11e-95ec-4c74-81ee-5327fbf99826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:56.925533 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b090b11e-95ec-4c74-81ee-5327fbf99826 None None] MFA Rules not processed for user `cf6cd4f44dbd408196059977fe78885e`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:56.926763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b090b11e-95ec-4c74-81ee-5327fbf99826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:56.988673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1123/2252] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:01.065193 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=12 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:06.977997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=53 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:09.954447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:09.955010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:09.955010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:09.974338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] MFA Rules not processed for user `7c4dee65a8054f028fae113d5c31406e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:09.977726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:10.034461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1130/2253] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:58:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:17.087024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272fd94-0a99-45d8-95ff-388758c69fdd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:17.087595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272fd94-0a99-45d8-95ff-388758c69fdd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:17.087595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272fd94-0a99-45d8-95ff-388758c69fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:17.107716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4272fd94-0a99-45d8-95ff-388758c69fdd None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:17.108969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4272fd94-0a99-45d8-95ff-388758c69fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:17.117128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1124/2254] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:17.136638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:17.149384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90853646-7a90-446d-a145-4eb9dcd4867c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:17.154945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:17.155567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:17.155888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:17.156170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:17.164426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:17.166510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:17.176119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1131/2255] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:21.906780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037eb3-b9ca-45cc-aaea-4ef7149f1251 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.907368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037eb3-b9ca-45cc-aaea-4ef7149f1251 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.907368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037eb3-b9ca-45cc-aaea-4ef7149f1251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.927438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f5037eb3-b9ca-45cc-aaea-4ef7149f1251 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:21.928703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f5037eb3-b9ca-45cc-aaea-4ef7149f1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:21.937682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1125/2256] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:21.952796 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:21.964618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1157d3b-b5c0-4c72-b59c-c010712a0ef3 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:21.971436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:21.972311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.972645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.972939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.982292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:21.983968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:21.995381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1132/2257] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:25.589846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1cf4-eafd-4838-b2d0-cc22262eb113 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:25.590415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1cf4-eafd-4838-b2d0-cc22262eb113 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:25.590415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1cf4-eafd-4838-b2d0-cc22262eb113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:25.612961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ef1e1cf4-eafd-4838-b2d0-cc22262eb113 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:25.614296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ef1e1cf4-eafd-4838-b2d0-cc22262eb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:25.623074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1126/2258] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:25.646775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:25.658765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384794-cedb-4cc0-9c3d-f025f4da0a8a service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:25.664496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:25.665122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:25.665411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:25.666058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:25.675192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:25.676859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:25.687686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1133/2259] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:29.878611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008fa5-3829-44f2-87e0-08823abc870e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:29.879140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008fa5-3829-44f2-87e0-08823abc870e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:29.879516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008fa5-3829-44f2-87e0-08823abc870e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:29.899364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-75008fa5-3829-44f2-87e0-08823abc870e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:29.900642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-75008fa5-3829-44f2-87e0-08823abc870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:29.909059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1127/2260] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:29.924195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:29.935971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1215b1-bb89-47c2-8a8d-7ed17791d5d8 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:29.941802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:29.942452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:29.943216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:29.943216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:29.952300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:29.953894 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:29.964034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1134/2261] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:34.141574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:34.142138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:34.142138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:34.162281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:34.163602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:34.172166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1128/2262] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jul 25 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:34.195052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:34.201923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=50 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:34.208076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2acd48-f8aa-493e-9e60-8382f0778505 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:34.215048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:34.215680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:34.216004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:34.216422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:34.226599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:34.230579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:34.241971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1135/2263] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:58:40.048474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:40.059273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb4b2-b7af-42e8-98b4-c058b4c292b2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:40.063387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:40.064057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:40.064345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:40.064660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:40.066677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:40.082237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:40.083783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02529-2103-402c-bbc4-aef169c060b4 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:40.096157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1129/2264] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:58:41.954287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:41.964029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5e56-cbfc-4b59-9cd7-6607b7e9706d service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:41.967743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:41.968392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:41.968705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:41.968986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:41.970807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:41.985768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:41.987152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:41.999994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1136/2265] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:50.090871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=21 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:51.993649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=11 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:56.005796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:56.007546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:56.007546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:56.027079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] MFA Rules not processed for user `b59a8ab5cdfd4dbabe6fb7c871f543e6`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:56.028354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:56.085640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1130/2266] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:58:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:56.258752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:56.260304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:56.345512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66bc56-af54-4bdc-9a44-95128aafaf5b service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:56.349794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:56.350682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:56.350962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:56.351243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:56.353944 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:56.366704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:56.369552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:56.381373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1137/2267] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:56.469863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:56.482316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f80696-1598-41ed-807c-e54eb29a5fe9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:56.486242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:56.486874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:56.487157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:56.487689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:56.489359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:56.501272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:56.502812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56b0a2-cb05-4499-ab7c-79b6789c443d service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:56.512800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1131/2268] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:59.750117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:59.763207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8590f-d2fa-400c-ac7e-9b8979c52e9f service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:59.768775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:59.769399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:59.769685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:59.769962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:59.771808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:59.783482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:59.785165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:59.795014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1138/2269] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:06.507788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=31 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:08.556191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:08.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:08.556730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:08.578636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] MFA Rules not processed for user `7f54b07b4dbc4e67b44a1c3ff6d60226`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:08.579940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:08.587832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1132/2270] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:09.326097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:09.342630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58db5d-289d-40c7-a12a-674c9925d118 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:09.348742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:09.349370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:09.349683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:09.349963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:09.353239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:09.379490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:09.381136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:09.407984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1139/2271] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:10.487150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:10.498230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030eb7e-54d6-4526-801b-9a30f8373593 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:10.502591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:10.503431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:10.504063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:10.504454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:10.506987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:10.522099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:10.524723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:10.540314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1133/2272] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:12.525901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:12.541514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61fe4-e117-410f-bd86-04a60aada989 service placement] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:12.545305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:12.545927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:12.546209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:12.546482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:12.548338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:12.558641 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:12.560139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:12.568777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1140/2273] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:13.858670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:13.860739 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:13.882897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b598a4-d10f-48b7-bb47-bb2c4c5900cf service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:13.892581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:13.893251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:13.893534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:13.893977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] PATH_INFO: `/v3/users/cf6cd4f44dbd408196059977fe78885e` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:13.895964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6cd4f44dbd408196059977fe78885e)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:13.900363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.035972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.053331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7015b32-2a14-489a-a09d-23d0d392c73d service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.060119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.061084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.061526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.061818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.064892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:14.079186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.081780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.094014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1141/2274] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:14.181821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6cd4f44dbd408196059977fe78885e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.182624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6cd4f44dbd408196059977fe78885e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.312057 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6cd4f44dbd408196059977fe78885e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.313834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6cd4f44dbd408196059977fe78885e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.334006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6cd4f44dbd408196059977fe78885e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.351713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1134/2275] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:13 2022] DELETE /identity/v3/users/cf6cd4f44dbd408196059977fe78885e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:14.647231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.658248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730002f2-f3e7-4964-a516-63e4b3d67a3f service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.728544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.729308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.729685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.729966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] PATH_INFO: `/v3/projects/d6fd500efd6b4ea48e3d981cad8eb995` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.731242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fd500efd6b4ea48e3d981cad8eb995)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.733374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.908354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fd500efd6b4ea48e3d981cad8eb995', 'request_id': 'req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.913008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:14.922947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fd500efd6b4ea48e3d981cad8eb995', 'request_id': 'req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:14.934358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fd500efd6b4ea48e3d981cad8eb995', 'request_id': 'req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:15.015526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] The token cache is being invalidate because project d6fd500efd6b4ea48e3d981cad8eb995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:15.015953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:15.016643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:15.030724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1142/2276] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:14 2022] DELETE /identity/v3/projects/d6fd500efd6b4ea48e3d981cad8eb995 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:15.365355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:15.367642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:15.489443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4b1ee-2732-436f-804c-9f7166e34b07 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:15.570012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:15.604081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:15.605545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:15.606132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:15.606828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:15.609242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:15.632144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:15.634786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:15.648331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1135/2277] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:17.228933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:17.231241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:17.251368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:17.254079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:17.261102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cb28-d3d3-47b1-94d9-cbab198a06b0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:17.281714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:17.282587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:17.285243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:17.285712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:17.291384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:17.321092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:17.323448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:17.345720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1143/2278] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:17.363453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0439-182e-49e9-b60e-38beced16f49 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:17.370194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:17.371377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:17.371922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:17.372574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] PATH_INFO: `/v3/users/0940cde66b1247b89a34b60a3dbe3452` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:17.374202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0940cde66b1247b89a34b60a3dbe3452)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:17.377989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:17.598073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0940cde66b1247b89a34b60a3dbe3452'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:17.598847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0940cde66b1247b89a34b60a3dbe3452'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:17.694949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0940cde66b1247b89a34b60a3dbe3452'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:17.696612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0940cde66b1247b89a34b60a3dbe3452'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:17.711199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-17b5dfe1-96e1-4f12-8896-73c8cd580028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0940cde66b1247b89a34b60a3dbe3452'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:17.729043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1136/2279] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:17 2022] DELETE /identity/v3/users/0940cde66b1247b89a34b60a3dbe3452 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:18.030950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:18.052889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff73e-6906-49d1-88dd-9ca60eb16780 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:18.166939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:18.168021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.168570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.169141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] PATH_INFO: `/v3/projects/c0bfa9bdb34f4c4382096c0a0330353c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.170922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bfa9bdb34f4c4382096c0a0330353c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:18.173319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:18.313659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bfa9bdb34f4c4382096c0a0330353c', 'request_id': 'req-4932ecf0-93ad-4829-8416-5f45650db03a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:18.320263 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bfa9bdb34f4c4382096c0a0330353c', 'request_id': 'req-4932ecf0-93ad-4829-8416-5f45650db03a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:18.327566 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bfa9bdb34f4c4382096c0a0330353c', 'request_id': 'req-4932ecf0-93ad-4829-8416-5f45650db03a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:18.420725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] The token cache is being invalidate because project c0bfa9bdb34f4c4382096c0a0330353c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:18.421133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:18.421853 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4932ecf0-93ad-4829-8416-5f45650db03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:18.423392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1144/2280] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:18 2022] DELETE /identity/v3/projects/c0bfa9bdb34f4c4382096c0a0330353c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:18.428764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.429408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.429553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.466458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:18.468160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:18.535180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:18.551655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1137/2281] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:18.559491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.559883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.560112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.582523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:18.583742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:18.592761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1145/2282] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:18.597254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:18.610958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d0ce7-a45f-4d9a-9f87-cac301415b44 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:18.617380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:18.618305 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.618751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.619121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.619826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:18.620218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:18.621752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:18.641149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1138/2283] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:18.642825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:18.654623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6da1-7610-46c4-9db9-46b5436dcf8e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:18.660764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:18.661404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.661642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.661926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.662610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:18.664602 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:18.765787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1146/2284] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:18 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:18.769856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:18.780973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469497-1291-45a1-8c71-d6b6c0d94daa admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:18.845215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:18.845919 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.846202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.846664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.847174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:18.849202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:18.960243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1139/2285] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:18 2022] POST /identity/v3/users => generated 282 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:18.965980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:18.978172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f746a-a912-4259-893e-076f962a17c6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:18.983364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:18.984033 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.984351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.984661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.985379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:18.986988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:18.998745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1147/2286] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:19.003297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.014541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9dab9-a232-4e8d-92ef-bcf259355af8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.019652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755143-0113-4967-9734-2e8b0c0f487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.020251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755143-0113-4967-9734-2e8b0c0f487a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.020539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755143-0113-4967-9734-2e8b0c0f487a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.020820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755143-0113-4967-9734-2e8b0c0f487a admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.021532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b755143-0113-4967-9734-2e8b0c0f487a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.024402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b755143-0113-4967-9734-2e8b0c0f487a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.042073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1140/2287] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:19.043125 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.053905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8880ea-b5d5-4f6e-b501-4923e16767ab admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.059116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.059834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.060206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.060408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] PATH_INFO: `/v3/projects/b9558420702b402abdc04e6e564a5b38/users/a94ff50e687942d795386b0b51a9abc8/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.079085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9558420702b402abdc04e6e564a5b38, user_id=a94ff50e687942d795386b0b51a9abc8, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.080086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.082431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:19.180998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1148/2288] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:19 2022] PUT /identity/v3/projects/b9558420702b402abdc04e6e564a5b38/users/a94ff50e687942d795386b0b51a9abc8/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:19.192700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.192987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.193322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.221929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] MFA Rules not processed for user `a94ff50e687942d795386b0b51a9abc8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:19.223184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:19.302652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1141/2289] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:19.307030 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.381672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf4b3-775a-4944-89d5-bdbde21999ac admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.387046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.387912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.388212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.388494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.389215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.391136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.514056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1149/2290] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:19 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:19.518131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.529550 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d5bc4-88c3-44b9-bec2-c2c5befb05a0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.582689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:19.595734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.596542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.596998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.597460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.598385 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.600899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.678116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1142/2291] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:19 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:19.683309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.694039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59849df-508d-4af0-bfeb-ae39329179d1 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.699897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.700532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.700829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.701113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.701875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.703642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.715106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1150/2292] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:19.723089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.733611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45df5-5606-4a60-b50a-de3827e03037 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.738416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.739103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.739525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.743200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] PATH_INFO: `/v3/projects/28ea089387944e49a9b1eb60e9d22f8b/users/781b92acb1cd4fe0b98a54098d39b795/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.756089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ea089387944e49a9b1eb60e9d22f8b, user_id=781b92acb1cd4fe0b98a54098d39b795, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.759429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.870325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1143/2293] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:19 2022] PUT /identity/v3/projects/28ea089387944e49a9b1eb60e9d22f8b/users/781b92acb1cd4fe0b98a54098d39b795/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:19.871339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.881687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d44c-ce6a-4a8e-bf38-dc80de3c01f6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.941273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db5e0-4037-425d-904b-9a99186f5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.942002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db5e0-4037-425d-904b-9a99186f5084 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.942323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db5e0-4037-425d-904b-9a99186f5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.942603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db5e0-4037-425d-904b-9a99186f5084 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.943353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db5e0-4037-425d-904b-9a99186f5084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.944990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db5e0-4037-425d-904b-9a99186f5084 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.956569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1151/2294] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:19.963235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:19.974278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd969a7-94fa-4fed-9963-46db2f56b1f1 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:19.980152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:19.980902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:19.981211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:19.981555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] PATH_INFO: `/v3/projects/28ea089387944e49a9b1eb60e9d22f8b/users/781b92acb1cd4fe0b98a54098d39b795/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:19.983654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ea089387944e49a9b1eb60e9d22f8b, user_id=781b92acb1cd4fe0b98a54098d39b795, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:19.986502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:19.997219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1144/2295] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:19 2022] PUT /identity/v3/projects/28ea089387944e49a9b1eb60e9d22f8b/users/781b92acb1cd4fe0b98a54098d39b795/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:20.008447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:20.008744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:20.009069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:20.039413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] MFA Rules not processed for user `781b92acb1cd4fe0b98a54098d39b795`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:20.040816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:20.117545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1152/2296] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:20.130244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:20.132052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:20.203482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240077-fe36-473e-9d3e-59393793cc3d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:20.208258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef2d7b-8bd0-4fd6-8c26-424f45ddf992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:20.208891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2d7b-8bd0-4fd6-8c26-424f45ddf992 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:20.209170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2d7b-8bd0-4fd6-8c26-424f45ddf992 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:20.209445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2d7b-8bd0-4fd6-8c26-424f45ddf992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:20.220594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef2d7b-8bd0-4fd6-8c26-424f45ddf992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:20.222091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef2d7b-8bd0-4fd6-8c26-424f45ddf992 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:20.232534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1145/2297] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:20.252695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:21.255130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:21.322858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ff335-9f8d-40de-98ed-59c2307d4f4c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:21.327578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:21.328277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:21.328567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:21.328871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] PATH_INFO: `/v3/users/a94ff50e687942d795386b0b51a9abc8` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:21.330072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94ff50e687942d795386b0b51a9abc8)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:21.332082 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:21.552385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94ff50e687942d795386b0b51a9abc8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:21.553016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94ff50e687942d795386b0b51a9abc8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:21.560717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94ff50e687942d795386b0b51a9abc8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:21.561398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94ff50e687942d795386b0b51a9abc8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:21.575791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94ff50e687942d795386b0b51a9abc8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:21.698163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1153/2298] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:21 2022] DELETE /identity/v3/users/a94ff50e687942d795386b0b51a9abc8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:21.700039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:21.700759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:21.700759 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:21.722237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:21.736572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:21.842798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1146/2299] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:21.852969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:21.854436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:21.915905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758de37-3dab-44d9-94df-d74dce573f60 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:21.919910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:21.920444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:21.920731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:21.921010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:21.931515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:21.933014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:21.942800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1154/2300] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:22.420217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:22.421675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:22.435401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04921-8ff6-4be6-a100-666e82b0f609 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:22.440084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:22.444258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:22.444258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:22.444258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] PATH_INFO: `/v3/projects/b9558420702b402abdc04e6e564a5b38` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:22.444258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9558420702b402abdc04e6e564a5b38)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:22.444828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:22.565066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:22.571411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9558420702b402abdc04e6e564a5b38', 'request_id': 'req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.640676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9558420702b402abdc04e6e564a5b38', 'request_id': 'req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.648749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9558420702b402abdc04e6e564a5b38', 'request_id': 'req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.661681 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] The token cache is being invalidate because project b9558420702b402abdc04e6e564a5b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:22.662027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.662821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.665100 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1147/2301] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:22 2022] DELETE /identity/v3/projects/b9558420702b402abdc04e6e564a5b38 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:22.669404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:22.680492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95d41-c53d-4e22-a310-d19d728bd33b service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:22.689531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:22.739440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:22.740113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:22.740403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:22.740683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] PATH_INFO: `/v3/users/781b92acb1cd4fe0b98a54098d39b795` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:22.741843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=781b92acb1cd4fe0b98a54098d39b795)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:22.743835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:22.926666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781b92acb1cd4fe0b98a54098d39b795'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.927282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781b92acb1cd4fe0b98a54098d39b795'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.934666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781b92acb1cd4fe0b98a54098d39b795'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.935364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781b92acb1cd4fe0b98a54098d39b795'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:22.948929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8555237-edb9-4bb8-8165-ac0181148bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781b92acb1cd4fe0b98a54098d39b795'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:23.072554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1155/2302] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:22 2022] DELETE /identity/v3/users/781b92acb1cd4fe0b98a54098d39b795 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:23.779289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:23.781075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:23.795573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7148cb-d79a-4b9d-a069-e32a1471e6fc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:23.870882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:23.871641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:23.871979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:23.872261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] PATH_INFO: `/v3/projects/28ea089387944e49a9b1eb60e9d22f8b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:23.873552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ea089387944e49a9b1eb60e9d22f8b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:23.876311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.017573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ea089387944e49a9b1eb60e9d22f8b', 'request_id': 'req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:24.100354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ea089387944e49a9b1eb60e9d22f8b', 'request_id': 'req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:24.107545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ea089387944e49a9b1eb60e9d22f8b', 'request_id': 'req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:24.120798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] The token cache is being invalidate because project 28ea089387944e49a9b1eb60e9d22f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:24.121120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:24.121757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5c172bbb-f4a1-4d6b-9353-ccbde5a99d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:24.123330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1148/2303] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:23 2022] DELETE /identity/v3/projects/28ea089387944e49a9b1eb60e9d22f8b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:24.128918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.129394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.133443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.150885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:24.152567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:24.233721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1156/2304] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:24.242624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.243295 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.243777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.265503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:24.266809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:24.276409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1149/2305] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:24.280719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:24.292526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f148b4-fa42-4d74-afdc-9772b7454886 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:24.297810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:24.298462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.298887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.299310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.300284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:24.300453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:24.302824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.316473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1157/2306] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:24.321150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:24.341870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c7e9-5da8-451b-ae3e-1fb99318113f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:24.347504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:24.348106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.348450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.348959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.349727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:24.352907 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.423269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1150/2307] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:24 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:24.427346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:24.438255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d92f7-bfbc-434e-8ece-5c8484a08f39 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:24.456142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:24.514113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:24.515244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.515540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.515912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.516708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:24.518740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.620091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1158/2308] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:24 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:24.624440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:24.637697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103484e8-4cf8-4cd1-950a-9f65a3c403ee admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:24.642611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:24.643245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.644001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.644001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.644598 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:24.646398 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.660396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1151/2309] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:24.665024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:24.678697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ee3d-e8bf-49cd-97ed-f77f6941a312 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:24.683879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba816-b743-4849-9f9b-b15012ad07d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:24.684594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba816-b743-4849-9f9b-b15012ad07d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.684955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba816-b743-4849-9f9b-b15012ad07d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.685308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba816-b743-4849-9f9b-b15012ad07d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.686094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba816-b743-4849-9f9b-b15012ad07d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:24.687858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba816-b743-4849-9f9b-b15012ad07d7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.703527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1159/2310] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:24.704761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:24.715568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ffd7-ff91-4523-9308-c201815efcf2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:24.720402 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:24.721089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.721371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.721652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] PATH_INFO: `/v3/projects/87b5bacca89b449d9b8ff9e27d4701c8/users/70fc134824d54f1088cdcc06911dc57f/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.740694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b5bacca89b449d9b8ff9e27d4701c8, user_id=70fc134824d54f1088cdcc06911dc57f, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:24.743959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:24.747231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:24.824203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1152/2311] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:24 2022] PUT /identity/v3/projects/87b5bacca89b449d9b8ff9e27d4701c8/users/70fc134824d54f1088cdcc06911dc57f/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:24.837223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:24.837638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:24.838113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:24.873630 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] MFA Rules not processed for user `70fc134824d54f1088cdcc06911dc57f`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:24.873852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:24.973883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1160/2312] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:24.979226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.080172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52767a81-f4b9-4047-9e6a-adf71ff62e55 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.086113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.086950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.087315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.087516 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.088244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.091110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.194440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1153/2313] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:24 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:25.195728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.207064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f90b32-44ab-4adf-8673-e35c6df40e4e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.289795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.290438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.290719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.291691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.292532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.294468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.400223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1161/2314] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:25 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:25.405869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.416326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94551-1b69-43fd-81a6-bda7f758a2c7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.422163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.422797 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.423079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.423352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.424124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.425729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.442717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1154/2315] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:25.444026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.456560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24a99-e0bd-4c12-b44b-9b3355f145d5 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.461346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.462148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.462438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.462717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] PATH_INFO: `/v3/projects/4ad82bc8235647bdb0359b6e1d33ca81/users/0ec3d4704f874c7882154aadce7fa5fe/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.485037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:25.488530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad82bc8235647bdb0359b6e1d33ca81, user_id=0ec3d4704f874c7882154aadce7fa5fe, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.491500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.595347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1162/2316] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:25 2022] PUT /identity/v3/projects/4ad82bc8235647bdb0359b6e1d33ca81/users/0ec3d4704f874c7882154aadce7fa5fe/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:25.599709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.610117 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ec337-1e01-493d-bdb9-ec219c99f578 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.667936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c79d-7783-41e9-83b0-1d893a53fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.668555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c79d-7783-41e9-83b0-1d893a53fa76 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.668839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c79d-7783-41e9-83b0-1d893a53fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.669130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c79d-7783-41e9-83b0-1d893a53fa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.669823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c79d-7783-41e9-83b0-1d893a53fa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.671425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c79d-7783-41e9-83b0-1d893a53fa76 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.682990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1155/2317] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:25.687546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.699244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3a88c-f449-405d-8796-00eb21b15272 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.705045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.705733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.706023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.706399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] PATH_INFO: `/v3/projects/4ad82bc8235647bdb0359b6e1d33ca81/users/0ec3d4704f874c7882154aadce7fa5fe/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.708728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad82bc8235647bdb0359b6e1d33ca81, user_id=0ec3d4704f874c7882154aadce7fa5fe, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.714080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.728050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1163/2318] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:25 2022] PUT /identity/v3/projects/4ad82bc8235647bdb0359b6e1d33ca81/users/0ec3d4704f874c7882154aadce7fa5fe/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:25.740324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.740559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.740908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.783246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] MFA Rules not processed for user `0ec3d4704f874c7882154aadce7fa5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:25.783470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:25.843977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:25.863256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1156/2319] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:25.875653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:25.877724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:25.938782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ce2f-46c3-4523-9a8e-9f78efc75e77 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:25.942472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295528f-0845-48ef-90ce-f0d1ebc39013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:25.943089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295528f-0845-48ef-90ce-f0d1ebc39013 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:25.943374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295528f-0845-48ef-90ce-f0d1ebc39013 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:25.943648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295528f-0845-48ef-90ce-f0d1ebc39013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:25.953439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295528f-0845-48ef-90ce-f0d1ebc39013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:25.955158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295528f-0845-48ef-90ce-f0d1ebc39013 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:25.965747 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1164/2320] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:28.937886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:29.008093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3063-8f4e-4100-84ba-a13b1e971b62 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:29.012509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:29.013152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:29.013434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:29.013710 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] PATH_INFO: `/v3/users/70fc134824d54f1088cdcc06911dc57f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:29.014869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fc134824d54f1088cdcc06911dc57f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:29.016842 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:29.203713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fc134824d54f1088cdcc06911dc57f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:29.204469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fc134824d54f1088cdcc06911dc57f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:29.265630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fc134824d54f1088cdcc06911dc57f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:29.266325 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fc134824d54f1088cdcc06911dc57f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:29.281008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fc134824d54f1088cdcc06911dc57f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:29.294498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1157/2321] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:28 2022] DELETE /identity/v3/users/70fc134824d54f1088cdcc06911dc57f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:29.301532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:29.302053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:29.302603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:29.322169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:29.323386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:29.385453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1165/2322] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:29.395499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:29.396976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:29.456792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47be0ea-8830-40c4-942a-dd09568e5c1e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:29.460640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:29.461229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:29.461511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:29.461787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:29.473692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:29.475128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:29.485206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1158/2323] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:29.905855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:29.907381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:29.920589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a2042-68a3-4570-8124-c29c095ab449 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:29.925380 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:29.926039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:29.926327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:29.926612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] PATH_INFO: `/v3/projects/87b5bacca89b449d9b8ff9e27d4701c8` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:29.927845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b5bacca89b449d9b8ff9e27d4701c8)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:29.929783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:30.060140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b5bacca89b449d9b8ff9e27d4701c8', 'request_id': 'req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.066760 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b5bacca89b449d9b8ff9e27d4701c8', 'request_id': 'req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.072980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b5bacca89b449d9b8ff9e27d4701c8', 'request_id': 'req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.214807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] The token cache is being invalidate because project 87b5bacca89b449d9b8ff9e27d4701c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:30.230343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.230343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.230343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1166/2324] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:29 2022] DELETE /identity/v3/projects/87b5bacca89b449d9b8ff9e27d4701c8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:30.230660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:30.232952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9620-b9dd-456b-8bd2-e4cf38f4bb29 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:30.242960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:30.303577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:30.304418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:30.304711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:30.304992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] PATH_INFO: `/v3/users/0ec3d4704f874c7882154aadce7fa5fe` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:30.306346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec3d4704f874c7882154aadce7fa5fe)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:30.312303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:30.535636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec3d4704f874c7882154aadce7fa5fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.536349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec3d4704f874c7882154aadce7fa5fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.646591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec3d4704f874c7882154aadce7fa5fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.647248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec3d4704f874c7882154aadce7fa5fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.670538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c52c4e11-9202-4169-8f08-503102e25806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec3d4704f874c7882154aadce7fa5fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:30.698744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1159/2325] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:30 2022] DELETE /identity/v3/users/0ec3d4704f874c7882154aadce7fa5fe => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:31.359994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:31.363146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:31.375338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:31.380275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c592b-cfcb-414f-8da7-41bb365ba7d0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:31.458640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:31.459365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.460495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.460495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] PATH_INFO: `/v3/projects/4ad82bc8235647bdb0359b6e1d33ca81` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.462104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad82bc8235647bdb0359b6e1d33ca81)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:31.464333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:31.613855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad82bc8235647bdb0359b6e1d33ca81', 'request_id': 'req-a28115b1-90de-4da4-90e3-75438d4a346f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:31.622774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad82bc8235647bdb0359b6e1d33ca81', 'request_id': 'req-a28115b1-90de-4da4-90e3-75438d4a346f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:31.630013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad82bc8235647bdb0359b6e1d33ca81', 'request_id': 'req-a28115b1-90de-4da4-90e3-75438d4a346f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:31.713725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] The token cache is being invalidate because project 4ad82bc8235647bdb0359b6e1d33ca81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:31.714036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:31.714922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a28115b1-90de-4da4-90e3-75438d4a346f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:31.722242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1167/2326] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:31 2022] DELETE /identity/v3/projects/4ad82bc8235647bdb0359b6e1d33ca81 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:31.724946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.725487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.725487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.758947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:31.760299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:31.836821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1160/2327] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:31.846449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.846746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.847021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.879031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:31.880588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:31.890724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1168/2328] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:31.895021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:31.906009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e42462-a71b-4d9c-990e-1548be27aaa7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:31.912850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:31.913504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.913791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.914067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.914874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:31.915206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:31.916975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:31.931459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1161/2329] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:31.936144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:31.945674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ece56-c4b3-4c73-bd21-3c51ef281abb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:31.951104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:31.951736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.952053 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.952336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.953017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:31.954952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.062910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1169/2330] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:31 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:32.067494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.079724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120573-58e4-43c8-9457-dded1c550a2a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.098084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:32.141000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.141639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.141921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.142201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.142881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.144987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.227923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1162/2331] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:32 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:32.229289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.240252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3411e4-52c7-4f45-a1d7-94245344bd52 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.246776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.247520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.247838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.248176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.248908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.250572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.262038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1170/2332] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:32.267627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.278324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65306cf-e365-47cd-9003-df20f220c1b8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.285196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7f4f-d0fb-4137-b615-1c43ff57ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.285843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7f4f-d0fb-4137-b615-1c43ff57ee80 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.286133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7f4f-d0fb-4137-b615-1c43ff57ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.286410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7f4f-d0fb-4137-b615-1c43ff57ee80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.287121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7f4f-d0fb-4137-b615-1c43ff57ee80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.288795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7f4f-d0fb-4137-b615-1c43ff57ee80 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.303436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1163/2333] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:32.307544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.317105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1f1d5-0caf-46f5-860f-e5da97d4a642 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.321901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.322595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.322950 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.323176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] PATH_INFO: `/v3/projects/5e86b19b2f4e431d8509df4c78f6945f/users/4da9d8308d044347b9e1baf46d944e17/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.340844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e86b19b2f4e431d8509df4c78f6945f, user_id=4da9d8308d044347b9e1baf46d944e17, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.343436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.476283 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1171/2334] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:32 2022] PUT /identity/v3/projects/5e86b19b2f4e431d8509df4c78f6945f/users/4da9d8308d044347b9e1baf46d944e17/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:32.488873 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.489199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.489521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.527795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] MFA Rules not processed for user `4da9d8308d044347b9e1baf46d944e17`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:32.529059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:32.598124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1164/2335] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:32.603472 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.639511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:32.671812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61217-c9bf-4de5-8f3e-c1d5c89aca0e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.677730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.679571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.679571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.679571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.679571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.681713 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.806293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1172/2336] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:32 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:32.810491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.828608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597fbb5-881f-47c9-94cc-7670702972f1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.903384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.904476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.904892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.905318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.906120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.908276 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:33.007178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1165/2337] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:32 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:33.009004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:33.022254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c862bd-4c88-4daf-879b-43416845d507 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:33.033032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:33.035271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:33.035631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:33.037881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:33.038793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:33.045811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:33.084808 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1173/2338] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:33.089745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:33.106275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa01e2-6a2d-4ccb-9ef9-b3445096cf28 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:33.114442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:33.115234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:33.115699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:33.116038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] PATH_INFO: `/v3/projects/cf3555ae221e4af9bc21c91d21237320/users/0d18847bc6bf47928a690e6ceed96b8b/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:33.139162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3555ae221e4af9bc21c91d21237320, user_id=0d18847bc6bf47928a690e6ceed96b8b, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:33.142541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:33.146407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:33.245946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1166/2339] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:33 2022] PUT /identity/v3/projects/cf3555ae221e4af9bc21c91d21237320/users/0d18847bc6bf47928a690e6ceed96b8b/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:33.247924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:33.261971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410af25-fea7-4fbb-a281-ffb13c927188 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:33.360514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb07d-44e6-4a79-b5cf-3b41725cabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:33.361465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb07d-44e6-4a79-b5cf-3b41725cabe4 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:33.362085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb07d-44e6-4a79-b5cf-3b41725cabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:33.362500 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb07d-44e6-4a79-b5cf-3b41725cabe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:33.363323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb07d-44e6-4a79-b5cf-3b41725cabe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:33.365475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb07d-44e6-4a79-b5cf-3b41725cabe4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:33.382144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1174/2340] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:33.383691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:33.408331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e2f0-46a2-4a55-bdba-2bafed2aedc0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:33.415546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:33.416571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:33.417024 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:33.417490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] PATH_INFO: `/v3/projects/cf3555ae221e4af9bc21c91d21237320/users/0d18847bc6bf47928a690e6ceed96b8b/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:33.420252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3555ae221e4af9bc21c91d21237320, user_id=0d18847bc6bf47928a690e6ceed96b8b, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:33.423609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:33.450067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1167/2341] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:33 2022] PUT /identity/v3/projects/cf3555ae221e4af9bc21c91d21237320/users/0d18847bc6bf47928a690e6ceed96b8b/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:33.460378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:33.460679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:33.460963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:33.502241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] MFA Rules not processed for user `0d18847bc6bf47928a690e6ceed96b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:33.509109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:33.597826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1175/2342] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:33.614942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:33.616828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:33.705576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253674-5981-4889-95dd-5fd6293185a2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:33.710138 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:33.710786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:33.711068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:33.712856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:33.728139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:33.730125 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:33.745877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1168/2343] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:35.000107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:35.007037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5869-4704-4542-afbe-0f11c10603c0 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:35.012543 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18847bc6bf47928a690e6ceed96b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3555ae221e4af9bc21c91d21237320', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:35.013279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:35.013574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:35.013893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:35.014615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:35.014930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:35.016583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:35.033273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1176/2344] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:35.034407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:35.044905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4b3c9-0e34-4f9a-9ca9-8d449050c176 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:35.050061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18847bc6bf47928a690e6ceed96b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3555ae221e4af9bc21c91d21237320', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:35.050769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:35.051331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:35.051642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:35.052357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:35.054333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:35.151586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1169/2345] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:35 2022] POST /identity/v3/projects => generated 353 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:35.156887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:35.170437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7eb8-a130-4e86-9171-d89cfd899233 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:35.190393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:35.242880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18847bc6bf47928a690e6ceed96b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3555ae221e4af9bc21c91d21237320', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:35.243737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:35.244057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:35.244343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:35.245066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:35.245388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:35.247080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:35.264843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1177/2346] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:35.308522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:35.322556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d117d7d-64b0-4d24-8452-8bd6ec61c996 tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:35.327674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18847bc6bf47928a690e6ceed96b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3555ae221e4af9bc21c91d21237320', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:35.328369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:35.328660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:35.328943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] PATH_INFO: `/v3/projects/ec8999713f9341c48ba3be5ed92c2714` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:35.330159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec8999713f9341c48ba3be5ed92c2714)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:35.332135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:35.453796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8999713f9341c48ba3be5ed92c2714', 'request_id': 'req-04c0e667-0105-45ae-a428-f69797c138cd'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:35.512596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8999713f9341c48ba3be5ed92c2714', 'request_id': 'req-04c0e667-0105-45ae-a428-f69797c138cd'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:35.521925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8999713f9341c48ba3be5ed92c2714', 'request_id': 'req-04c0e667-0105-45ae-a428-f69797c138cd'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:35.537881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] The token cache is being invalidate because project ec8999713f9341c48ba3be5ed92c2714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:35.540189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:35.540189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-04c0e667-0105-45ae-a428-f69797c138cd tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:35.544446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1170/2347] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:35 2022] DELETE /identity/v3/projects/ec8999713f9341c48ba3be5ed92c2714 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:36.262760 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:36.266200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:36.345767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44df7-4f40-4dfc-94f6-69ba9e3f8c8f tempest-VolumeQuotaClassesTest-732343991 tempest-VolumeQuotaClassesTest-732343991-project-admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:36.414209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:36.415651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:36.415902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:36.416183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] PATH_INFO: `/v3/users/4da9d8308d044347b9e1baf46d944e17` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:36.417397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da9d8308d044347b9e1baf46d944e17)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:36.419323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:36.652330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da9d8308d044347b9e1baf46d944e17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:36.653057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da9d8308d044347b9e1baf46d944e17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:36.662364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da9d8308d044347b9e1baf46d944e17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:36.663495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da9d8308d044347b9e1baf46d944e17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:36.665351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:36.683133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da9d8308d044347b9e1baf46d944e17'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:36.940506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1178/2348] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:36 2022] DELETE /identity/v3/users/4da9d8308d044347b9e1baf46d944e17 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:36.946431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:36.946968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:36.946968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:36.965884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:36.968492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:37.011876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:37.030551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1171/2349] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:37.040553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:37.042506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:37.103626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f4ea-1e34-4c77-b139-c85efb5fb487 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:37.107347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:37.108005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:37.108291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:37.108567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:37.118538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:37.120155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:37.130329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1179/2350] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:37.578962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:37.580477 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:37.603023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2d1e-107e-49b9-967e-8427fc59e138 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:37.603023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:37.603023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:37.603023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:37.603606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] PATH_INFO: `/v3/projects/5e86b19b2f4e431d8509df4c78f6945f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:37.603606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e86b19b2f4e431d8509df4c78f6945f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:37.603606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:37.746628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e86b19b2f4e431d8509df4c78f6945f', 'request_id': 'req-deee2f74-7473-4510-80bb-32e027949df8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:37.829361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e86b19b2f4e431d8509df4c78f6945f', 'request_id': 'req-deee2f74-7473-4510-80bb-32e027949df8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:37.837662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e86b19b2f4e431d8509df4c78f6945f', 'request_id': 'req-deee2f74-7473-4510-80bb-32e027949df8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:37.849730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] The token cache is being invalidate because project 5e86b19b2f4e431d8509df4c78f6945f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:37.850033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:37.850704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:37.853260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1172/2351] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:37 2022] DELETE /identity/v3/projects/5e86b19b2f4e431d8509df4c78f6945f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:37.857770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:37.873654 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9becc41-28c1-4bc5-b5ab-e10c3445697b service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:37.938615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:37.938891 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:37.939128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:37.939409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] PATH_INFO: `/v3/users/0d18847bc6bf47928a690e6ceed96b8b` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:37.940669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d18847bc6bf47928a690e6ceed96b8b)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:37.942762 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:38.165632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d18847bc6bf47928a690e6ceed96b8b'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:38.166308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d18847bc6bf47928a690e6ceed96b8b'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:38.173587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d18847bc6bf47928a690e6ceed96b8b'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:38.174369 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d18847bc6bf47928a690e6ceed96b8b'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:38.187480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-180514d0-0a25-40d3-8b2e-d77f676c971a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d18847bc6bf47928a690e6ceed96b8b'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:38.191230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:38.237374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1180/2352] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:37 2022] DELETE /identity/v3/users/0d18847bc6bf47928a690e6ceed96b8b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:38.713832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:38.715602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:38.730893 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee2f74-7473-4510-80bb-32e027949df8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:38.798084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:38.798726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:38.799009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:38.799288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] PATH_INFO: `/v3/projects/cf3555ae221e4af9bc21c91d21237320` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:38.800534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3555ae221e4af9bc21c91d21237320)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:38.802445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:38.920339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3555ae221e4af9bc21c91d21237320', 'request_id': 'req-3aabfe4f-2c14-454c-97b6-6214c99505d7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:39.075367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3555ae221e4af9bc21c91d21237320', 'request_id': 'req-3aabfe4f-2c14-454c-97b6-6214c99505d7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:39.093884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3555ae221e4af9bc21c91d21237320', 'request_id': 'req-3aabfe4f-2c14-454c-97b6-6214c99505d7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:39.093884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:39.097561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] The token cache is being invalidate because project cf3555ae221e4af9bc21c91d21237320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:39.097925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:39.098832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3aabfe4f-2c14-454c-97b6-6214c99505d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:39.102044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1173/2353] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:38 2022] DELETE /identity/v3/projects/cf3555ae221e4af9bc21c91d21237320 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:39.108198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.108737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.108885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.139631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:39.139631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:39.223484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1181/2354] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:39.237643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.237643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.237643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.257544 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:39.260846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:39.269955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1174/2355] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:39.277520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:39.285978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c0474-0c4d-4d5f-aca1-4b80d0cd6382 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:39.290929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:39.291557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.291876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.292168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.292902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:39.293207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:39.294943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:39.311481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1182/2356] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:39.312648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:39.322077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac77751-6947-4d90-8cf0-463965eed952 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:39.327061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:39.327693 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.328012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.328294 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.328970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:39.330883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:39.530247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1175/2357] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:39 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:39.534862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:39.546678 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6aa8b-9d7c-4e3f-963f-e0da917b1504 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:39.618450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:39.624848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.624848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.624848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.624848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:39.624848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:39.723455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1183/2358] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:39 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:39.724697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:39.736975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb43f55-2cdf-4b17-87db-5f33de711bd3 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:39.742328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:39.743016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.743603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.744052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.744904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:39.746555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:39.759813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1176/2359] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:39.764217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:39.776275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21bdaa-4f4e-4de6-9170-fd030c71202d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:39.781234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e34b87-aeb9-4b55-906f-d899368b27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:39.781863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e34b87-aeb9-4b55-906f-d899368b27ca admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.782147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e34b87-aeb9-4b55-906f-d899368b27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.782422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e34b87-aeb9-4b55-906f-d899368b27ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.783137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e34b87-aeb9-4b55-906f-d899368b27ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:39.784831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e34b87-aeb9-4b55-906f-d899368b27ca admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:39.797105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1184/2360] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:39.801374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:39.812794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d487-59eb-4eb1-9e1b-2d31a9eb3cf2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:39.818590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:39.819311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.819606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.819905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] PATH_INFO: `/v3/projects/74889c780d764135b6aabbd3216fa9d6/users/8c16002e9d4247608011cd2c4bf5f186/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.837659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74889c780d764135b6aabbd3216fa9d6, user_id=8c16002e9d4247608011cd2c4bf5f186, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:39.840511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:39.933470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1177/2361] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:39 2022] PUT /identity/v3/projects/74889c780d764135b6aabbd3216fa9d6/users/8c16002e9d4247608011cd2c4bf5f186/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:39.943817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:39.944139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:39.944419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:39.973455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] MFA Rules not processed for user `8c16002e9d4247608011cd2c4bf5f186`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:39.974683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:40.030341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:40.048495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1185/2362] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:40.060700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:40.062459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:40.125275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bbae8-772b-44b2-809d-f8600a8a40b2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:40.129213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d476eac-c9f4-4595-8099-4bbb29ac8d17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:40.129828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d476eac-c9f4-4595-8099-4bbb29ac8d17 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:40.130106 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d476eac-c9f4-4595-8099-4bbb29ac8d17 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:40.130377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d476eac-c9f4-4595-8099-4bbb29ac8d17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:40.140171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d476eac-c9f4-4595-8099-4bbb29ac8d17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:40.141624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d476eac-c9f4-4595-8099-4bbb29ac8d17 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:40.151378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1178/2363] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:40.583474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:40.584138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:40.644943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1eedb-22c9-4eb3-8b8d-2b885d74c878 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:40.649130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:40.649772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:40.650066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:40.650341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:40.652180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:40.717304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:40.718869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:40.729532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1186/2364] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:41.518063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:41.518519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:41.518629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:41.545420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:41.546673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:41.614955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1179/2365] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 25 22:59:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:41.859633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:41.861255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:41.943482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424ced9-4673-4efe-9647-b3b3246b03f1 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:41.949339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:41.949985 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:41.950268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:41.950547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:41.959517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:41.961767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:41.970969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1187/2366] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 22:59:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 22:59:45.078952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:45.081928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:45.190612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:45.232999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461e17f-4e75-40f1-a583-3c2c3827872d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:45.238769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:45.239672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:45.242699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:45.242699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] PATH_INFO: `/v3/users/7c4dee65a8054f028fae113d5c31406e` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:45.242699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4dee65a8054f028fae113d5c31406e)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:45.243911 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:45.471685 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4dee65a8054f028fae113d5c31406e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:45.472441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4dee65a8054f028fae113d5c31406e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:45.585850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4dee65a8054f028fae113d5c31406e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:45.585850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4dee65a8054f028fae113d5c31406e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:45.603506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-113e5c97-9067-408a-b1d2-f5dbc93ab7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4dee65a8054f028fae113d5c31406e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:45.623068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1180/2367] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:45 2022] DELETE /identity/v3/users/7c4dee65a8054f028fae113d5c31406e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:45.980458 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:46.031936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18711be8-8cc5-4927-adce-c95edd642c4d service swift] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:46.039674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:46.122706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:46.123383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:46.123899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:46.124196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] PATH_INFO: `/v3/projects/c11aa37b98d34373a1fbca69d97d1374` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:46.127864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11aa37b98d34373a1fbca69d97d1374)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:46.131184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:46.281452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11aa37b98d34373a1fbca69d97d1374', 'request_id': 'req-5646829c-3502-4e0b-8e8a-c661e87508ab'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:46.289786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11aa37b98d34373a1fbca69d97d1374', 'request_id': 'req-5646829c-3502-4e0b-8e8a-c661e87508ab'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:46.295668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11aa37b98d34373a1fbca69d97d1374', 'request_id': 'req-5646829c-3502-4e0b-8e8a-c661e87508ab'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:46.415224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] The token cache is being invalidate because project c11aa37b98d34373a1fbca69d97d1374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:46.416091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:46.416574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-5646829c-3502-4e0b-8e8a-c661e87508ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:46.430656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1188/2368] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:45 2022] DELETE /identity/v3/projects/c11aa37b98d34373a1fbca69d97d1374 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:46.431375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:46.431375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:46.431375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:46.485435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:46.491273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:46.573139 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1181/2369] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:46.581524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:46.581626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:46.584367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:46.609994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:46.611226 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:46.619786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1189/2370] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:46.624687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:46.637228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e013f-f325-4d82-befa-8e91d47e6c94 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:46.642720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:46.643543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:46.643870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:46.644151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:46.644888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:46.645196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:46.646926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:46.660894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1182/2371] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:59:46.666077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:46.676420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b9284-238d-4fd6-94e2-3a41640b7141 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:46.682145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:46.682813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:46.683093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:46.683398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:46.684221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:46.686192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:46.821215 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1190/2372] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:46 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:46.832427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:46.837395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8b0c8-c844-486e-ad63-9e4dd75f3a7f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:46.874988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:46.915881 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:46.916609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:46.916850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:46.917135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:46.917852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:46.919922 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.131542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1183/2373] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:46 2022] POST /identity/v3/users => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:47.136233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:47.147979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7ff6e-e1ea-46b2-ae3e-ba40f2d17e23 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:47.157366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:47.158343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.158743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.159142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.160037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:47.163980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.180541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1191/2374] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:47.184773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:47.198136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdb7a1-9e05-4f58-a046-abed6885a33f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:47.205836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1220da7-069c-4599-a07e-cd2eb84de054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:47.206864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220da7-069c-4599-a07e-cd2eb84de054 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.207238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220da7-069c-4599-a07e-cd2eb84de054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.207588 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220da7-069c-4599-a07e-cd2eb84de054 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.208930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1220da7-069c-4599-a07e-cd2eb84de054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:47.210108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1220da7-069c-4599-a07e-cd2eb84de054 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.229421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1184/2375] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:47.232871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:47.246168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab360-f9bb-49de-88ac-0bac3569289e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:47.251600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:47.252416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.252887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.253665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] PATH_INFO: `/v3/projects/85f7cf28980d46b78f7fc6d2abda7bd3/users/acdab9de7aba4c41905056e2c886de00/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.273710 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f7cf28980d46b78f7fc6d2abda7bd3, user_id=acdab9de7aba4c41905056e2c886de00, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:47.277684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.375258 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1192/2376] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:47 2022] PUT /identity/v3/projects/85f7cf28980d46b78f7fc6d2abda7bd3/users/acdab9de7aba4c41905056e2c886de00/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:47.387430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.387721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.388108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.418795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] MFA Rules not processed for user `acdab9de7aba4c41905056e2c886de00`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:47.420006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:47.489600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1185/2377] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:47.494607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:47.566937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:47.602954 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd04-e030-4567-9cb9-b0f34e0322dd admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:47.613643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:47.613643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.614744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.614744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.615217 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:47.617662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.767000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1193/2378] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:47 2022] POST /identity/v3/projects => generated 403 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:47.769436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:47.783097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb820-997c-4d5e-bb22-e52b39fe0f2e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:47.862772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:47.864856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.864856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.864856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.865793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:47.873740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.954810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1186/2379] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:47 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:47.958816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:47.969304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200622-a843-4e5f-8bc4-9eef4a07fb94 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:47.974066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:47.974680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:47.974964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:47.975232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:47.975973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:47.981343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:47.995162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1194/2380] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:47.999642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:48.010913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b9ab-0678-496b-b9a0-1211e1e1cd29 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:48.015784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:48.016492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:48.016865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:48.017046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] PATH_INFO: `/v3/projects/1f601cab7b72497e8e05b394ffd0d45b/users/de42f8dd06aa47ec82fbcaa12ddee8f8/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:48.040816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f601cab7b72497e8e05b394ffd0d45b, user_id=de42f8dd06aa47ec82fbcaa12ddee8f8, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:48.043410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:48.165921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1187/2381] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:47 2022] PUT /identity/v3/projects/1f601cab7b72497e8e05b394ffd0d45b/users/de42f8dd06aa47ec82fbcaa12ddee8f8/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:48.169876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:48.183291 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d046f1-762f-4cd5-a66c-2694057f0ca2 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:48.267798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f1d5c-4543-4f6b-bb02-9bd1a5462ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:48.268457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1d5c-4543-4f6b-bb02-9bd1a5462ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:48.268742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1d5c-4543-4f6b-bb02-9bd1a5462ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:48.269017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1d5c-4543-4f6b-bb02-9bd1a5462ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:48.269743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1d5c-4543-4f6b-bb02-9bd1a5462ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:48.271324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1d5c-4543-4f6b-bb02-9bd1a5462ce8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:48.282345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1195/2382] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:48.287396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:48.298821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acc553-75cb-4954-b6a2-dc29f8423fb7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:48.305996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:48.306726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:48.307030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:48.307398 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] PATH_INFO: `/v3/projects/1f601cab7b72497e8e05b394ffd0d45b/users/de42f8dd06aa47ec82fbcaa12ddee8f8/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:48.309653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f601cab7b72497e8e05b394ffd0d45b, user_id=de42f8dd06aa47ec82fbcaa12ddee8f8, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:48.312481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:48.314921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:48.325128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1188/2383] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:48 2022] PUT /identity/v3/projects/1f601cab7b72497e8e05b394ffd0d45b/users/de42f8dd06aa47ec82fbcaa12ddee8f8/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:48.335341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:48.335638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:48.336540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:48.369097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] MFA Rules not processed for user `de42f8dd06aa47ec82fbcaa12ddee8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:48.370677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:48.457303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1196/2384] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:48.469658 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:48.472406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:48.542048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b7d3-0f71-4e1e-8c3f-4e2e4688c33c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:48.545929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5bc31-acf3-48c7-9484-cd3ac57c6a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:48.546574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5bc31-acf3-48c7-9484-cd3ac57c6a24 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:48.546871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5bc31-acf3-48c7-9484-cd3ac57c6a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:48.547145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5bc31-acf3-48c7-9484-cd3ac57c6a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:48.560317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5bc31-acf3-48c7-9484-cd3ac57c6a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:48.565092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5bc31-acf3-48c7-9484-cd3ac57c6a24 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:48.574611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1189/2385] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:48.733019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:48.767069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:48.802795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b9fd8-c0ff-4136-ab45-60cef5cbf10c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:48.808977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:48.809757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:48.810113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:48.810494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] PATH_INFO: `/v3/users/acdab9de7aba4c41905056e2c886de00` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:48.812540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdab9de7aba4c41905056e2c886de00)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:48.815329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:49.035393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdab9de7aba4c41905056e2c886de00'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:49.036140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdab9de7aba4c41905056e2c886de00'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:49.050668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdab9de7aba4c41905056e2c886de00'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:49.051446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdab9de7aba4c41905056e2c886de00'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:49.068469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdab9de7aba4c41905056e2c886de00'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:49.157236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1197/2386] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:48 2022] DELETE /identity/v3/users/acdab9de7aba4c41905056e2c886de00 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:49.159078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:49.159339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:49.159617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:49.184651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:49.185905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:49.252412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1190/2387] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:49.263953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:49.265603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:49.336606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907f33c-2186-427b-9a57-fcd687e7cc9b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:49.341244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:49.341940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:49.342186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:49.342469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:49.356691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:49.358170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:49.369732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1198/2388] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:49.880412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:49.881945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:49.926833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c7fa-c156-4524-a5ce-4b60af4c57e9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:49.932534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:49.934817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:49.934817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:49.934817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] PATH_INFO: `/v3/projects/85f7cf28980d46b78f7fc6d2abda7bd3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:49.935158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f7cf28980d46b78f7fc6d2abda7bd3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:49.937213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:50.061266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f7cf28980d46b78f7fc6d2abda7bd3', 'request_id': 'req-d0f0885c-2670-44e1-94ac-4192f209939d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.134373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f7cf28980d46b78f7fc6d2abda7bd3', 'request_id': 'req-d0f0885c-2670-44e1-94ac-4192f209939d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.141872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f7cf28980d46b78f7fc6d2abda7bd3', 'request_id': 'req-d0f0885c-2670-44e1-94ac-4192f209939d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.157214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] The token cache is being invalidate because project 85f7cf28980d46b78f7fc6d2abda7bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:50.157512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.158210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.163022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1191/2389] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:49 2022] DELETE /identity/v3/projects/85f7cf28980d46b78f7fc6d2abda7bd3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:50.164757 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:50.176048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab49ea-9aad-4eb1-bd66-9a6e2c9db39f service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:50.252865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:50.263216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:50.264110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:50.265071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:50.265071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] PATH_INFO: `/v3/users/de42f8dd06aa47ec82fbcaa12ddee8f8` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:50.266307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de42f8dd06aa47ec82fbcaa12ddee8f8)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:50.272244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:50.560969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de42f8dd06aa47ec82fbcaa12ddee8f8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.561888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de42f8dd06aa47ec82fbcaa12ddee8f8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.570140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de42f8dd06aa47ec82fbcaa12ddee8f8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.571696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de42f8dd06aa47ec82fbcaa12ddee8f8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.587267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-3c28bcd8-3bc9-452c-8a49-5b2657a3d115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de42f8dd06aa47ec82fbcaa12ddee8f8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:50.685224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1199/2390] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:50 2022] DELETE /identity/v3/users/de42f8dd06aa47ec82fbcaa12ddee8f8 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:51.358388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:51.360124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:51.374713 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0885c-2670-44e1-94ac-4192f209939d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:51.394202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:51.433473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:51.434118 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:51.434404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:51.434682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] PATH_INFO: `/v3/projects/1f601cab7b72497e8e05b394ffd0d45b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:51.435905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f601cab7b72497e8e05b394ffd0d45b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:51.437819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:51.559367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f601cab7b72497e8e05b394ffd0d45b', 'request_id': 'req-1e33d002-9062-4819-8c55-130605b3d19d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:51.669315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f601cab7b72497e8e05b394ffd0d45b', 'request_id': 'req-1e33d002-9062-4819-8c55-130605b3d19d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:51.678194 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f601cab7b72497e8e05b394ffd0d45b', 'request_id': 'req-1e33d002-9062-4819-8c55-130605b3d19d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:51.691880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] The token cache is being invalidate because project 1f601cab7b72497e8e05b394ffd0d45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:51.692177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:51.692849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e33d002-9062-4819-8c55-130605b3d19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:51.694691 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1192/2391] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:51 2022] DELETE /identity/v3/projects/1f601cab7b72497e8e05b394ffd0d45b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:51.700165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:51.700649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:51.701013 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:51.722218 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:51.723372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:51.804002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1200/2392] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:51.806765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:51.807083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:51.807332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:51.834676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:51.836607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:51.856321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1193/2393] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:51.860593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:51.874796 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5695f-0571-474d-ba83-e377de3cad07 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:51.887555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:51.888622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:51.889061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:51.891889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:51.893637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:51.894110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:51.896183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:51.910091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1201/2394] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:51.915350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:51.925248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a8e4-7fc9-444f-899f-6a3806fe76ca None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:51.935989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:51.936784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:51.937173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:51.937571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:51.938401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:51.940687 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.048012 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1194/2395] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:51 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:52.052149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.063161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843af9e-856d-4399-ad3f-93aa41ab11fe admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.123164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:52.130619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.131181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.131474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.131858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.132466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.134447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.250127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1202/2396] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:52 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:52.251732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.264637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9d485-6a64-40b0-9e28-44a82acca1a3 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.269298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.269926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.270209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.270482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.271182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.272833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.285811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1195/2397] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:52.290230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.300662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d634da-9f5c-443c-8925-2a806250895a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.307420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63bd16-8bfe-4b39-b05e-aae731c80d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.308097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63bd16-8bfe-4b39-b05e-aae731c80d8b admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.308391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63bd16-8bfe-4b39-b05e-aae731c80d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.308677 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63bd16-8bfe-4b39-b05e-aae731c80d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.309397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63bd16-8bfe-4b39-b05e-aae731c80d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.314394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63bd16-8bfe-4b39-b05e-aae731c80d8b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.323847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1203/2398] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:52.328388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.342023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c15373-7083-420f-bb76-3d5abf765a8f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.347560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.348285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.348569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.350956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] PATH_INFO: `/v3/projects/1c7dd0d72d0d48f4afd5d71207ff9cf6/users/f7930b7b61ab415fab8c5e7556809a14/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.369757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7dd0d72d0d48f4afd5d71207ff9cf6, user_id=f7930b7b61ab415fab8c5e7556809a14, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.372576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.458301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1196/2399] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:52 2022] PUT /identity/v3/projects/1c7dd0d72d0d48f4afd5d71207ff9cf6/users/f7930b7b61ab415fab8c5e7556809a14/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:52.471553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.471883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.472167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.512647 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] MFA Rules not processed for user `f7930b7b61ab415fab8c5e7556809a14`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:52.514001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:52.585607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1204/2400] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:52.590437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.641062 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:52.652857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.654783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:52.659641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d131-5603-4a5c-8929-5a81471e8168 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.664863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.665453 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.665812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.666157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.666920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.669035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.672730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e6ce4-57b8-4972-a67f-c155c80009b5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.678178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.678824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.679147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.682568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] PATH_INFO: `/v3/users/dac5117b95ce4887a97bead7608d5355` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.682568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac5117b95ce4887a97bead7608d5355)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.683926 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.769994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1197/2401] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:52 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:52.774067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.840426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6531-8aee-4141-90ca-4ebbda6cce06 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.845328 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.845953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.846285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.846561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.847238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.849178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:52.947166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac5117b95ce4887a97bead7608d5355'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:52.947820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac5117b95ce4887a97bead7608d5355'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:52.955075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac5117b95ce4887a97bead7608d5355'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:52.955720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac5117b95ce4887a97bead7608d5355'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:52.969877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1198/2402] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:52 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:52.970131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac5117b95ce4887a97bead7608d5355'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:52.971048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:52.972874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:52.985899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba58815-b353-46bb-b7db-f140bfc02b2c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:52.990553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:52.992640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:52.992640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:52.992640 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:52.993430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:52.995034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.005369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1199/2403] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:53.010126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.020096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510a6b-56b9-4d71-8339-27ce6d864e2f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.024874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.025527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.025809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.026082 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] PATH_INFO: `/v3/projects/7036340b52c74a63a2aefe7a02d0e29b/users/45c0f4a69744448ea365b7c3afd5df0a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.042574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7036340b52c74a63a2aefe7a02d0e29b, user_id=45c0f4a69744448ea365b7c3afd5df0a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.045317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.075233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1205/2404] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:52 2022] DELETE /identity/v3/users/dac5117b95ce4887a97bead7608d5355 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:53.129389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1200/2405] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:53 2022] PUT /identity/v3/projects/7036340b52c74a63a2aefe7a02d0e29b/users/45c0f4a69744448ea365b7c3afd5df0a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:53.136375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.181577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:53.203138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e902ba-d7a9-4cca-ab2f-e3dc201097e9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.270247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e83da-8e3c-44c3-a6a8-fd60911474a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.270912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e83da-8e3c-44c3-a6a8-fd60911474a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.271205 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e83da-8e3c-44c3-a6a8-fd60911474a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.271485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e83da-8e3c-44c3-a6a8-fd60911474a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.272236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e83da-8e3c-44c3-a6a8-fd60911474a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.274320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e83da-8e3c-44c3-a6a8-fd60911474a5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.284981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1206/2406] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:53.289331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.302302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e765443-6890-4245-9f98-cc439cd0ed29 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.308159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.308890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.309177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.309482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] PATH_INFO: `/v3/projects/7036340b52c74a63a2aefe7a02d0e29b/users/45c0f4a69744448ea365b7c3afd5df0a/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.311487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7036340b52c74a63a2aefe7a02d0e29b, user_id=45c0f4a69744448ea365b7c3afd5df0a, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.314213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.324994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1201/2407] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:53 2022] PUT /identity/v3/projects/7036340b52c74a63a2aefe7a02d0e29b/users/45c0f4a69744448ea365b7c3afd5df0a/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:53.335275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.336162 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.336549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.359519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.361298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:53.368327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] MFA Rules not processed for user `45c0f4a69744448ea365b7c3afd5df0a`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:53.369549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:53.443191 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c754d2-d617-4604-bf3d-7ebf93f2f3be admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.446648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1207/2408] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:53.449319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.450152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.450495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.450803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] PATH_INFO: `/v3/projects/695911a335d1454ab3f7e1fdf700a4cc` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.452088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695911a335d1454ab3f7e1fdf700a4cc)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.454075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.458326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.459718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:53.472848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:53.520204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cad71-9a8e-4570-955f-a34b5cd5d2d6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.524872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.525440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.525727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.526006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.535232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.536697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.547495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1208/2409] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:53.581256 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695911a335d1454ab3f7e1fdf700a4cc', 'request_id': 'req-52750f77-d359-4ae8-829a-3c866ffd1888'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.670560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695911a335d1454ab3f7e1fdf700a4cc', 'request_id': 'req-52750f77-d359-4ae8-829a-3c866ffd1888'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.678252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695911a335d1454ab3f7e1fdf700a4cc', 'request_id': 'req-52750f77-d359-4ae8-829a-3c866ffd1888'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.691028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] The token cache is being invalidate because project 695911a335d1454ab3f7e1fdf700a4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:53.691378 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.692097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.693723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1202/2410] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:53 2022] DELETE /identity/v3/projects/695911a335d1454ab3f7e1fdf700a4cc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:53.698524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.709374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718950d-7b28-4ca9-9d82-e538ff20d3d7 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.714813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:53.760277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:53.761680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:53.770824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.771478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.771784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.772145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] PATH_INFO: `/v3/users/8907e090ba444714a606620fc48313a1` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.774017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8907e090ba444714a606620fc48313a1)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.775979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.824688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750f77-d359-4ae8-829a-3c866ffd1888 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:53.828541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:53.829187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:53.829478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:53.829762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:53.831657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:53.894706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:53.896205 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:53.906423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1203/2411] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:53.949490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8907e090ba444714a606620fc48313a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.950260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8907e090ba444714a606620fc48313a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.957987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8907e090ba444714a606620fc48313a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.958861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8907e090ba444714a606620fc48313a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:53.972865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8907e090ba444714a606620fc48313a1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:54.054121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1209/2412] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:53 2022] DELETE /identity/v3/users/8907e090ba444714a606620fc48313a1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:54.330483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:54.332085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:54.350468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38f56-0833-43fb-a7f3-82b12cebcd03 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:54.419408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:54.425221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:54.428122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:54.428122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:54.428122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] PATH_INFO: `/v3/projects/e7c78cc4ecb9457f9ef99acc23c60926` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:54.428122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c78cc4ecb9457f9ef99acc23c60926)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:54.429781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:54.535589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c78cc4ecb9457f9ef99acc23c60926', 'request_id': 'req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:54.602661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c78cc4ecb9457f9ef99acc23c60926', 'request_id': 'req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:54.608841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c78cc4ecb9457f9ef99acc23c60926', 'request_id': 'req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:54.621736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] The token cache is being invalidate because project e7c78cc4ecb9457f9ef99acc23c60926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:54.622213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:54.622900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d7d0e2ee-b697-4b5d-b132-21f7b791a12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:54.624724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1204/2413] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:54 2022] DELETE /identity/v3/projects/e7c78cc4ecb9457f9ef99acc23c60926 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:56.689172 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:56.690739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:56.704655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec147e-23c4-42fc-b018-025afe07c5a0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:56.763387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:56.764101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:56.764383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:56.764660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] PATH_INFO: `/v3/users/8c16002e9d4247608011cd2c4bf5f186` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:56.765907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c16002e9d4247608011cd2c4bf5f186)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:56.767922 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:56.906329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:56.921079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c16002e9d4247608011cd2c4bf5f186'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:56.921693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c16002e9d4247608011cd2c4bf5f186'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:56.928831 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c16002e9d4247608011cd2c4bf5f186'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:56.935527 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c16002e9d4247608011cd2c4bf5f186'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:56.942351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c16002e9d4247608011cd2c4bf5f186'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:57.022940 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1210/2414] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 22:59:56 2022] DELETE /identity/v3/users/8c16002e9d4247608011cd2c4bf5f186 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:57.027556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:57.028145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:57.028145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:57.047488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:57.048764 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:57.112225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1205/2415] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:57.122257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:57.123671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:57.181425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00497e9d-7e51-4abe-aa34-eb74d79fc1fc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:57.185061 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab58eeb-ff3e-4026-b123-877561bf25df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:57.185688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58eeb-ff3e-4026-b123-877561bf25df service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:57.185975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58eeb-ff3e-4026-b123-877561bf25df service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:57.186255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58eeb-ff3e-4026-b123-877561bf25df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:57.195720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab58eeb-ff3e-4026-b123-877561bf25df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:57.197178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab58eeb-ff3e-4026-b123-877561bf25df service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:57.206783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1211/2416] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:57.689918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:57.691717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:57.707669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadd1c9-24f7-4f92-bce8-da278d10f442 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:57.714886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:57.715635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:57.716110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:57.716353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] PATH_INFO: `/v3/projects/74889c780d764135b6aabbd3216fa9d6` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:57.717879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74889c780d764135b6aabbd3216fa9d6)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:57.720865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:57.847483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74889c780d764135b6aabbd3216fa9d6', 'request_id': 'req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:57.910717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74889c780d764135b6aabbd3216fa9d6', 'request_id': 'req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:57.917883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74889c780d764135b6aabbd3216fa9d6', 'request_id': 'req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:57.929712 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] The token cache is being invalidate because project 74889c780d764135b6aabbd3216fa9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:59:57.930043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:57.930722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-45033dd0-c26e-4bb8-bf43-ce4156b5ed1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:59:57.932350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1206/2417] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 22:59:57 2022] DELETE /identity/v3/projects/74889c780d764135b6aabbd3216fa9d6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:57.937529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:57.938081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:57.938081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:57.957634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:57.958852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:58.021734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1212/2418] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:58.030159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.030694 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.030791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.052156 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:58.053417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:58.061913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1207/2419] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:58.066448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.077034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860175eb-c251-47dc-9049-2c8d397455e2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.081854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.082478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.082768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.083049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.083786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:58.084208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.086262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.098428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1213/2420] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:59:58.103545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.109420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:58.113181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1b00d-0b39-44c0-b286-5206448919eb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.118101 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.118718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.119004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.119285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.120072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.121992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.255825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1208/2421] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:58 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:58.261200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.271191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93df9-38eb-44fd-9123-0789403f3532 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.312605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:58.337261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.337990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.338167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.338444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.339120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.341087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.440864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1214/2422] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:58 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:58.445663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.457129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc055-f422-4086-af00-7b79737ed7d6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.462581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.463823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.463823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.464116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.464885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.466684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.478115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1209/2423] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:58.482785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.493658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62321-34e3-4f52-b121-eb9ac70fef16 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.498613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f4efe-2582-41e9-a811-b790fd739cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.501170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f4efe-2582-41e9-a811-b790fd739cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.501170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f4efe-2582-41e9-a811-b790fd739cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.501170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f4efe-2582-41e9-a811-b790fd739cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.501170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f4efe-2582-41e9-a811-b790fd739cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.502157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f4efe-2582-41e9-a811-b790fd739cd2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.514676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1215/2424] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:58.519064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.530000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36946f-332b-46dc-bf9f-1435a9de2775 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.534720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.535482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.535732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.536047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] PATH_INFO: `/v3/projects/e0d2362fb8684a5094612b6e53bd90f2/users/1976def46f7d4d8d9c9b8f9d39070f69/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.551189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d2362fb8684a5094612b6e53bd90f2, user_id=1976def46f7d4d8d9c9b8f9d39070f69, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.554016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.641023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1210/2425] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:58 2022] PUT /identity/v3/projects/e0d2362fb8684a5094612b6e53bd90f2/users/1976def46f7d4d8d9c9b8f9d39070f69/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:58.709820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.710111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.710447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.738315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] MFA Rules not processed for user `1976def46f7d4d8d9c9b8f9d39070f69`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:58.739464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:58.806089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1216/2426] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 22:59:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:58.817335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:58.819035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:58.877227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a48ee-e7a4-49b9-b3f7-277e5e2b8218 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:58.881210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e2b8-7fbb-4771-9328-e96b7ab21a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:58.881830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e2b8-7fbb-4771-9328-e96b7ab21a33 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:58.882124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e2b8-7fbb-4771-9328-e96b7ab21a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:58.882404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e2b8-7fbb-4771-9328-e96b7ab21a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:58.890880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e2b8-7fbb-4771-9328-e96b7ab21a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:58.892456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e2b8-7fbb-4771-9328-e96b7ab21a33 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:58.902158 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1211/2427] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:03.144977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:03.153658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:03.230505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d1ab-2301-4713-a13c-66a540890e8d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:03.235001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:03.235653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.235975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.236256 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] PATH_INFO: `/v3/users/f7930b7b61ab415fab8c5e7556809a14` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.237911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7930b7b61ab415fab8c5e7556809a14)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:03.239892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:03.458129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7930b7b61ab415fab8c5e7556809a14'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:03.458752 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7930b7b61ab415fab8c5e7556809a14'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:03.460188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:03.467494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7930b7b61ab415fab8c5e7556809a14'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:03.468240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7930b7b61ab415fab8c5e7556809a14'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:03.482818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7930b7b61ab415fab8c5e7556809a14'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:03.563673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1217/2428] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:03 2022] DELETE /identity/v3/users/f7930b7b61ab415fab8c5e7556809a14 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:03.569183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.569647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.569846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.593047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:03.594485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:03.665433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1212/2429] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:03.681230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:03.682814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:03.766692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314759-7362-42e5-945d-3edf98482849 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:03.770403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:03.771142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:03.771432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:03.771712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:03.782835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:03.784155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:03.798383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1218/2430] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:04.427422 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.429108 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:04.443157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44020dc0-157c-4f25-9804-e5106db23729 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.448823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.449523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.449808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.450089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] PATH_INFO: `/v3/projects/1c7dd0d72d0d48f4afd5d71207ff9cf6` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.451476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7dd0d72d0d48f4afd5d71207ff9cf6)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.453345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:04.628338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:04.631296 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7dd0d72d0d48f4afd5d71207ff9cf6', 'request_id': 'req-78363d35-48a9-4cd0-bb49-53eb2eea0793'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:04.774073 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7dd0d72d0d48f4afd5d71207ff9cf6', 'request_id': 'req-78363d35-48a9-4cd0-bb49-53eb2eea0793'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:04.780404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7dd0d72d0d48f4afd5d71207ff9cf6', 'request_id': 'req-78363d35-48a9-4cd0-bb49-53eb2eea0793'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:04.792233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] The token cache is being invalidate because project 1c7dd0d72d0d48f4afd5d71207ff9cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:04.792528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:04.793229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:04.794778 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1213/2431] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:04 2022] DELETE /identity/v3/projects/1c7dd0d72d0d48f4afd5d71207ff9cf6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:04.799154 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:04.810164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66351909-28e0-4f4f-9c5f-3cbcd32cb3f0 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:04.874590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:04.875242 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:04.875563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:04.875932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] PATH_INFO: `/v3/users/45c0f4a69744448ea365b7c3afd5df0a` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:04.877119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c0f4a69744448ea365b7c3afd5df0a)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:04.879332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:05.106311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c0f4a69744448ea365b7c3afd5df0a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.107080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c0f4a69744448ea365b7c3afd5df0a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.114429 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c0f4a69744448ea365b7c3afd5df0a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.118413 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c0f4a69744448ea365b7c3afd5df0a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.126651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:05.129328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-aa626a67-9ff2-4568-a025-6334144dbab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c0f4a69744448ea365b7c3afd5df0a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:05.229758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1219/2432] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:04 2022] DELETE /identity/v3/users/45c0f4a69744448ea365b7c3afd5df0a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:05.691128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:05.692684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:05.711651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78363d35-48a9-4cd0-bb49-53eb2eea0793 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:05.781985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:05.782639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:05.782951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:05.784337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] PATH_INFO: `/v3/projects/7036340b52c74a63a2aefe7a02d0e29b` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:05.784603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7036340b52c74a63a2aefe7a02d0e29b)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:05.786569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:05.916722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7036340b52c74a63a2aefe7a02d0e29b', 'request_id': 'req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.080114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7036340b52c74a63a2aefe7a02d0e29b', 'request_id': 'req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.087375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7036340b52c74a63a2aefe7a02d0e29b', 'request_id': 'req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.099291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] The token cache is being invalidate because project 7036340b52c74a63a2aefe7a02d0e29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:06.099589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.100265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-0fb08fcb-4021-48f2-9c0d-75e5f8dc84df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.102795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1214/2433] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:05 2022] DELETE /identity/v3/projects/7036340b52c74a63a2aefe7a02d0e29b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:06.107705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.108293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.108293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.128643 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:06.130005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.192204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1220/2434] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:06.200534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.200829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.201166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.222192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:06.223444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.233425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1215/2435] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:06.239431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.256935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbcbc-149c-4df8-9951-d78cac7380f2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.263259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.263997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.264284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.264565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.265294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:06.265607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.267248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.281622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1221/2436] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:00:06.287895 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.300476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9fe81-1ee6-4563-9fcd-1ddcc5369037 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.305975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.306629 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.307159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.307445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.308299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.310343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.311021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.312976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.326754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59723-f639-4602-8387-8cb7022b304b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.331832 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.336316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.336316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.336316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] PATH_INFO: `/v3/users/1976def46f7d4d8d9c9b8f9d39070f69` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.336316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1976def46f7d4d8d9c9b8f9d39070f69)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.337012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.432529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1216/2437] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:06 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:06.436697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.482839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:06.505902 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44747cd-90d3-4757-bd37-4f5e00e06c77 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.512303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.513120 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.513260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.513500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.514180 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.516217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.535800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1976def46f7d4d8d9c9b8f9d39070f69'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.536712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1976def46f7d4d8d9c9b8f9d39070f69'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.545353 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1976def46f7d4d8d9c9b8f9d39070f69'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.546129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1976def46f7d4d8d9c9b8f9d39070f69'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.560249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f30c1209-9cc3-4f05-8d53-741047ae821c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1976def46f7d4d8d9c9b8f9d39070f69'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:06.666523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1222/2438] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:06 2022] DELETE /identity/v3/users/1976def46f7d4d8d9c9b8f9d39070f69 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:06.667365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1217/2439] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:06 2022] POST /identity/v3/users => generated 284 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:06.671517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.672067 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.672366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.672652 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.673324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.686067 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47c9c3-379e-415b-a46a-704aa0759253 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.693469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:06.695530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.746261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:06.758505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.759216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.759632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.759948 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.760672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.762345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.772284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1223/2440] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:06.779820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1218/2441] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:06.781605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.789996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.792084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5e4d1-7171-4f2f-84a2-258c2f4c2cea None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.792852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:06.797672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.798764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.799139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.799483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.800344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.802057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.816008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1224/2442] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:06.819297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:06.832957 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27872fad-381e-4652-af41-f04cadce23f5 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.838516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.839751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.840072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.840389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] PATH_INFO: `/v3/projects/61171ce6666443349d9176ee7e7c7b15/users/740dea1482144d56824cbdfb462f04fe/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.860579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61171ce6666443349d9176ee7e7c7b15, user_id=740dea1482144d56824cbdfb462f04fe, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.863363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.883273 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ef14-79b6-41f1-83c7-82eb380398fd admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:06.887036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3b1c-87fa-411a-bfd4-a72f04469bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:06.887660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3b1c-87fa-411a-bfd4-a72f04469bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.887970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3b1c-87fa-411a-bfd4-a72f04469bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.888243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3b1c-87fa-411a-bfd4-a72f04469bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:06.898004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b3b1c-87fa-411a-bfd4-a72f04469bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:06.899442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b3b1c-87fa-411a-bfd4-a72f04469bf9 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:06.909625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1219/2443] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:06.969729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1225/2444] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:06 2022] PUT /identity/v3/projects/61171ce6666443349d9176ee7e7c7b15/users/740dea1482144d56824cbdfb462f04fe/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:06.981791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:06.982085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:06.982366 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.015940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] MFA Rules not processed for user `740dea1482144d56824cbdfb462f04fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:07.017212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:07.089648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:07.103006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1220/2445] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:07.107639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.191786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe30d7f-e982-4b31-8a23-64d63d1c4e2d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.198210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.198848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.199123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.199393 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.200123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.204322 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.336317 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1226/2446] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:07 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:07.338604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.358467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eff53-c217-4786-9a2e-700989b69468 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.413047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.416600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:07.439309 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.440573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.441169 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.442545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.443821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.455018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.510721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c216b-b15d-417c-80af-172548448ed8 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.515886 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.516848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.516848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.517079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] PATH_INFO: `/v3/projects/e0d2362fb8684a5094612b6e53bd90f2` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.518301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d2362fb8684a5094612b6e53bd90f2)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.520288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.538817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1221/2447] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:07 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:07.540972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.555869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd51c1-4842-4706-835a-e46b85d3338e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.561345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.579348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.579348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.579348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.579348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.579348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.584170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1222/2448] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:07.588865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.600874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0b63-b2c1-4ab5-bf65-550c2d79153b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.607461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.608525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.609056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.609560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] PATH_INFO: `/v3/projects/fd0417a9d11e47d1a07f189a512eab0c/users/127a087ff06545a1a1c21126d0af562e/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.631450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0417a9d11e47d1a07f189a512eab0c, user_id=127a087ff06545a1a1c21126d0af562e, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.634927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.807555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1223/2449] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:07 2022] PUT /identity/v3/projects/fd0417a9d11e47d1a07f189a512eab0c/users/127a087ff06545a1a1c21126d0af562e/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:07.811462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.813499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:07.821909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d2362fb8684a5094612b6e53bd90f2', 'request_id': 'req-98779e50-e790-4aa5-9bc9-17a3351344fb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:07.828767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d2362fb8684a5094612b6e53bd90f2', 'request_id': 'req-98779e50-e790-4aa5-9bc9-17a3351344fb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:07.840270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d2362fb8684a5094612b6e53bd90f2', 'request_id': 'req-98779e50-e790-4aa5-9bc9-17a3351344fb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:07.876874 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f867fb1-2f83-4f6d-8034-3fb993cfdc7e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.919675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] The token cache is being invalidate because project e0d2362fb8684a5094612b6e53bd90f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:07.920089 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:07.920851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-98779e50-e790-4aa5-9bc9-17a3351344fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:07.922499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1227/2450] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:07 2022] DELETE /identity/v3/projects/e0d2362fb8684a5094612b6e53bd90f2 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:07.927347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861fe0-48c4-4d29-9a84-dd9ed22bb2f5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.927782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861fe0-48c4-4d29-9a84-dd9ed22bb2f5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.928157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861fe0-48c4-4d29-9a84-dd9ed22bb2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.941044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:07.948668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.953313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.953313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.953313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.953313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.953313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.957845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-8b861fe0-48c4-4d29-9a84-dd9ed22bb2f5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:07.959097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8b861fe0-48c4-4d29-9a84-dd9ed22bb2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:07.964824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1224/2451] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:07.967721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1228/2452] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:07.970098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.972061 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:07.975293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.975653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.976699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.987480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980e138-d4f8-48a9-bdaf-0b8496282dfb admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.995030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf44b8-37ea-4ebb-aff4-f4e6589050dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.996511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf44b8-37ea-4ebb-aff4-f4e6589050dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.996802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf44b8-37ea-4ebb-aff4-f4e6589050dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.997097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf44b8-37ea-4ebb-aff4-f4e6589050dd admin admin] PATH_INFO: `/v3/projects/fd0417a9d11e47d1a07f189a512eab0c/users/127a087ff06545a1a1c21126d0af562e/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.999171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf44b8-37ea-4ebb-aff4-f4e6589050dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0417a9d11e47d1a07f189a512eab0c, user_id=127a087ff06545a1a1c21126d0af562e, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.000055 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:08.001522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:08.001898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf44b8-37ea-4ebb-aff4-f4e6589050dd admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.012702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1229/2453] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:08.016246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1225/2454] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:07 2022] PUT /identity/v3/projects/fd0417a9d11e47d1a07f189a512eab0c/users/127a087ff06545a1a1c21126d0af562e/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:08.017057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.027055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.027358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.027480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca7153-23e6-4ef4-8a96-51f7c9ffb12a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.027637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.066145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] MFA Rules not processed for user `127a087ff06545a1a1c21126d0af562e`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:08.084241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:08.090764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.091571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.091965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.092377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.093167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:08.093547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.095361 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.109754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1230/2455] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:00:08.114251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.125728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b3618-4ed4-4a80-bb6d-1361fd4118e7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.132958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.133655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.133946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.134221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.134942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.136994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.157153 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1226/2456] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:08.171566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.172974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:08.236672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3006ff7-f21d-432c-be43-e1114a2ed52d None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.237691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1231/2457] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:08 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:08.242547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.325884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.326602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.326933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.327406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.330977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ab64e-7af4-4a4d-a0b7-3f61174bf2c0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.338173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.340509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.341208 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.341736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.342536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.345424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.380450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:08.408920 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.410396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.420200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1227/2458] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:08.447237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1232/2459] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:08 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:08.451688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.462603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a010de-2c75-4585-9e0a-8c5ba7102941 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.467397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.468071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.468365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.468645 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.469382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.471008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.485206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1228/2460] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:08.489101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.501608 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679188a3-4b9e-4b4b-aa96-5b547aa7b42b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.507427 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.508594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.508880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.509158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.509916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.511548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.523311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1233/2461] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:08.528070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.545350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ec33-8975-4779-a927-eee50ef4e2c7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.549551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.551275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.551998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.552292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.552578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] PATH_INFO: `/v3/projects/8060ac0acb9a41bb8aa279c63a43c4f9/users/29edab86f50c4934a40ae4d10a2083e9/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.558173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:08.562468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cffb2-8fc0-4256-b3e1-3b7cc59f5201 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.568203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.571066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.571066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.571066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.571381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8060ac0acb9a41bb8aa279c63a43c4f9, user_id=29edab86f50c4934a40ae4d10a2083e9, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.572216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:08.573540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.635454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.636661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0078e9-fcc7-42d4-b02e-1baa60478596 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:08.645573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1234/2462] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:08.654852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1229/2463] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:08 2022] PUT /identity/v3/projects/8060ac0acb9a41bb8aa279c63a43c4f9/users/29edab86f50c4934a40ae4d10a2083e9/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:08.675449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.675744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.676074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.709699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] MFA Rules not processed for user `29edab86f50c4934a40ae4d10a2083e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:08.710987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:08.790199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1235/2464] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:08.794600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:08.861832 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892da9-b5ed-48e6-a2de-949f131b4285 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:08.867092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:08.867715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:08.868037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:08.868318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:08.869203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:08.871037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.008473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1230/2465] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:08 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:09.010035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.025436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a6167-0156-44d6-beb9-2103e9fd3c02 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.113136 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.114186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.114653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.115130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.116864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.120094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.209335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1236/2466] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:09 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:09.213017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.223904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b31e6-3868-43b8-80d8-e55027859f40 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.228599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.229306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.229596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.229879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.230610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.232253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.244123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1231/2467] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:09.248561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.260121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feabc4-fff3-48dc-a4c6-51ffc138fd9e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.264887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.265555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.265845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.266127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] PATH_INFO: `/v3/projects/ccedd41777554d9bbd0885242dcca779/users/cc8e25b172c8466ea3772fbe417554e9/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.283323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccedd41777554d9bbd0885242dcca779, user_id=cc8e25b172c8466ea3772fbe417554e9, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.286195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.381939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.384308 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:09.391783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:09.398328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1237/2468] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:09 2022] PUT /identity/v3/projects/ccedd41777554d9bbd0885242dcca779/users/cc8e25b172c8466ea3772fbe417554e9/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:09.402277 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.491321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971159fd-404f-428f-ad24-d923c2e4cedc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.495930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21a71-a08b-4456-b3b2-0d1705e89492 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.497447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:09.499863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.500577 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.500860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.501227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.502084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.503980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.514825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1238/2469] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:09.519171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.529301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704b2e-7655-4bc8-8d1c-2cb56520288b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.534137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbefd2-73b1-4e34-ab07-ed41c8c04393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.534806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbefd2-73b1-4e34-ab07-ed41c8c04393 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.535118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbefd2-73b1-4e34-ab07-ed41c8c04393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.535403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbefd2-73b1-4e34-ab07-ed41c8c04393 admin admin] PATH_INFO: `/v3/projects/ccedd41777554d9bbd0885242dcca779/users/cc8e25b172c8466ea3772fbe417554e9/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.537510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbefd2-73b1-4e34-ab07-ed41c8c04393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccedd41777554d9bbd0885242dcca779, user_id=cc8e25b172c8466ea3772fbe417554e9, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.540764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbefd2-73b1-4e34-ab07-ed41c8c04393 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.552404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1239/2470] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:09 2022] PUT /identity/v3/projects/ccedd41777554d9bbd0885242dcca779/users/cc8e25b172c8466ea3772fbe417554e9/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:09.563079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.564188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.564311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.564409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.564500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.564584 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.564680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.566260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:09.600564 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] MFA Rules not processed for user `cc8e25b172c8466ea3772fbe417554e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:09.602504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:09.655176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.656872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.667898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1232/2471] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:09.693777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1240/2472] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:09.705897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:09.777693 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfb50c-b76a-4ef0-8ddb-0555c22c6b9c service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:09.831163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a16c6-657a-4417-90a9-9185c7724b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:09.831821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a16c6-657a-4417-90a9-9185c7724b3b service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:09.832112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a16c6-657a-4417-90a9-9185c7724b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:09.832395 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a16c6-657a-4417-90a9-9185c7724b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:09.894228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a16c6-657a-4417-90a9-9185c7724b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:09.895594 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a16c6-657a-4417-90a9-9185c7724b3b service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:09.906132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1233/2473] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:09.926323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:13.170963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:13.273482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd841d1-d060-43b3-ba4c-9ebce2e7277e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:13.289637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:13.290724 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:13.291222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:13.291715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] PATH_INFO: `/v3/users/29edab86f50c4934a40ae4d10a2083e9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:13.294485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29edab86f50c4934a40ae4d10a2083e9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:13.306580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:13.326372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:13.550279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29edab86f50c4934a40ae4d10a2083e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:13.550945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29edab86f50c4934a40ae4d10a2083e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:13.558684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29edab86f50c4934a40ae4d10a2083e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:13.559395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29edab86f50c4934a40ae4d10a2083e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:13.573422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29edab86f50c4934a40ae4d10a2083e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:13.698167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1241/2474] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:13 2022] DELETE /identity/v3/users/29edab86f50c4934a40ae4d10a2083e9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:13.702779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:13.703272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:13.703387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:13.726417 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:13.727724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:13.788225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1234/2475] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:13.798924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:13.800456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:13.863562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d56be-701f-450e-9be1-83d30256e1f1 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:13.868026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:13.868658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:13.868948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:13.869230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:13.886020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:13.886020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:13.894387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1242/2476] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:14.051783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:14.053338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:14.065978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bfcfa-0124-4dbb-9a4d-301f60fee36a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:14.071811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:14.072522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:14.072866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:14.073143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] PATH_INFO: `/v3/users/740dea1482144d56824cbdfb462f04fe` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:14.074984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=740dea1482144d56824cbdfb462f04fe)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:14.076531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:14.289509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740dea1482144d56824cbdfb462f04fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.290179 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740dea1482144d56824cbdfb462f04fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.393295 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:14.395921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:14.396996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740dea1482144d56824cbdfb462f04fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.397758 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740dea1482144d56824cbdfb462f04fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.414182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-df0a6d35-6686-49d4-9b11-ea694ba67d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740dea1482144d56824cbdfb462f04fe'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.416195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11d5b-b13a-47ed-83d3-16e182cad6e3 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:14.426066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:14.427275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:14.427729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:14.428066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] PATH_INFO: `/v3/projects/8060ac0acb9a41bb8aa279c63a43c4f9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:14.429962 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8060ac0acb9a41bb8aa279c63a43c4f9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:14.430891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1235/2477] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:14 2022] DELETE /identity/v3/users/740dea1482144d56824cbdfb462f04fe => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:14.432454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:14.437436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:14.440886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:14.441186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:14.463916 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:14.465233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:14.486585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:14.527954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1236/2478] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:14.538013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:14.539906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:14.579693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8060ac0acb9a41bb8aa279c63a43c4f9', 'request_id': 'req-c3743e95-8e45-4b63-8891-3c9680824954'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.588274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8060ac0acb9a41bb8aa279c63a43c4f9', 'request_id': 'req-c3743e95-8e45-4b63-8891-3c9680824954'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.596195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8060ac0acb9a41bb8aa279c63a43c4f9', 'request_id': 'req-c3743e95-8e45-4b63-8891-3c9680824954'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.608047 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e2186-c5be-42a3-a3b7-ad50231e723f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:14.664168 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:14.664979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:14.665209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:14.665504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:14.701480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] The token cache is being invalidate because project 8060ac0acb9a41bb8aa279c63a43c4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:14.701785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.702531 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:14.708424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1243/2479] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:14 2022] DELETE /identity/v3/projects/8060ac0acb9a41bb8aa279c63a43c4f9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:14.710171 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:14.715302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:14.740507 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:14.776828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:14.779458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:14.792592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1237/2480] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:14.813383 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743e95-8e45-4b63-8891-3c9680824954 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:14.819065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:14.819896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:14.820400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:14.820687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] PATH_INFO: `/v3/users/cc8e25b172c8466ea3772fbe417554e9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:14.821935 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8e25b172c8466ea3772fbe417554e9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:14.824001 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:15.154640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8e25b172c8466ea3772fbe417554e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:15.155339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8e25b172c8466ea3772fbe417554e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:15.162987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8e25b172c8466ea3772fbe417554e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:15.164510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8e25b172c8466ea3772fbe417554e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:15.178018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8e25b172c8466ea3772fbe417554e9'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:15.253491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1244/2481] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:14 2022] DELETE /identity/v3/users/cc8e25b172c8466ea3772fbe417554e9 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:15.678914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:15.681055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:15.696807 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb9395-5c54-40de-88be-db8dcd7081aa service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:15.734449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:15.762595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:15.763170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:15.763452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:15.763734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] PATH_INFO: `/v3/projects/61171ce6666443349d9176ee7e7c7b15` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:15.764955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61171ce6666443349d9176ee7e7c7b15)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:15.766915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:15.858775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:15.865151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:15.876765 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4befd9-b667-408d-8a85-72f103525093 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:15.888939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:15.889951 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:15.892148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:15.892802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] PATH_INFO: `/v3/projects/ccedd41777554d9bbd0885242dcca779` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:15.894290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccedd41777554d9bbd0885242dcca779)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:15.897018 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:15.927310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61171ce6666443349d9176ee7e7c7b15', 'request_id': 'req-87b47aa3-fd04-41f7-bd70-1a926ee997a0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.082140 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61171ce6666443349d9176ee7e7c7b15', 'request_id': 'req-87b47aa3-fd04-41f7-bd70-1a926ee997a0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.089507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61171ce6666443349d9176ee7e7c7b15', 'request_id': 'req-87b47aa3-fd04-41f7-bd70-1a926ee997a0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.102610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] The token cache is being invalidate because project 61171ce6666443349d9176ee7e7c7b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:16.103489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.103672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccedd41777554d9bbd0885242dcca779', 'request_id': 'req-f336f564-996b-4288-8c91-6f2dc1d13eb3'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.104329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.106314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1238/2482] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:15 2022] DELETE /identity/v3/projects/61171ce6666443349d9176ee7e7c7b15 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:16.110999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.115682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccedd41777554d9bbd0885242dcca779', 'request_id': 'req-f336f564-996b-4288-8c91-6f2dc1d13eb3'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.115850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:16.119232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccedd41777554d9bbd0885242dcca779', 'request_id': 'req-f336f564-996b-4288-8c91-6f2dc1d13eb3'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.182102 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47aa3-fd04-41f7-bd70-1a926ee997a0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.237987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] The token cache is being invalidate because project ccedd41777554d9bbd0885242dcca779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:16.244332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.244332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f336f564-996b-4288-8c91-6f2dc1d13eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.244332 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1245/2483] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:15 2022] DELETE /identity/v3/projects/ccedd41777554d9bbd0885242dcca779 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:16.244612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.244612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.244612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.244612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] PATH_INFO: `/v3/users/127a087ff06545a1a1c21126d0af562e` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.244972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127a087ff06545a1a1c21126d0af562e)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.245843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:16.246660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cb19-132a-4072-ac95-11d7d8738258 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.247032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cb19-132a-4072-ac95-11d7d8738258 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.247603 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cb19-132a-4072-ac95-11d7d8738258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.263523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:16.273278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c162cb19-132a-4072-ac95-11d7d8738258 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:16.274984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c162cb19-132a-4072-ac95-11d7d8738258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:16.290262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1246/2484] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:16.293915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.294206 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.294489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.309207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:16.316915 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:16.318721 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:16.328387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1247/2485] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:16.332827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.343062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d452a-9f36-4b01-a7f2-8360a172d275 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.348009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.348634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.349024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.349290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.349970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:16.350253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.352115 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:16.365795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1248/2486] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:00:16.370145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.380998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85107b1-e928-4778-a4f1-bcb8148719e3 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.386426 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.387266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.387819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.387819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.391102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.391102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:16.500457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127a087ff06545a1a1c21126d0af562e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.501174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127a087ff06545a1a1c21126d0af562e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.522092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1249/2487] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:16 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:16.523744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.589930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d340-3488-4c0f-8dba-cceadbd612cc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.595320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.595990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.596314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.596674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.597540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.599780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:16.629444 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127a087ff06545a1a1c21126d0af562e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.630432 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127a087ff06545a1a1c21126d0af562e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.653425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127a087ff06545a1a1c21126d0af562e'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:16.670776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1239/2488] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:16 2022] DELETE /identity/v3/users/127a087ff06545a1a1c21126d0af562e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:16.712982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1250/2489] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:16 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:16.717967 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.719780 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:16.795260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40eef9-43ba-4ad3-80fd-b536ac3fd919 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.800495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.801113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.801400 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.801673 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.802368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.804530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:16.814754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1240/2490] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:16.818898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.831356 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9fdc3-b763-478a-a5a0-f9ddad7ab53a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.836194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5f7a3-7036-4bb9-98d4-ce6259ecfe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.836807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5f7a3-7036-4bb9-98d4-ce6259ecfe44 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.837091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5f7a3-7036-4bb9-98d4-ce6259ecfe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.837368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5f7a3-7036-4bb9-98d4-ce6259ecfe44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.838069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5f7a3-7036-4bb9-98d4-ce6259ecfe44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.839658 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5f7a3-7036-4bb9-98d4-ce6259ecfe44 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:16.850023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1251/2491] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:16.854485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:16.865016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3fa63-9932-4033-8860-892276e67e99 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:16.870682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:16.872489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:16.872786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:16.873070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] PATH_INFO: `/v3/projects/743cbb9452884066ae720dc504eee7f8/users/2212397575374e2d92cdd2a68bbc5535/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:16.891114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743cbb9452884066ae720dc504eee7f8, user_id=2212397575374e2d92cdd2a68bbc5535, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:16.894160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:17.008189 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1241/2492] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:16 2022] PUT /identity/v3/projects/743cbb9452884066ae720dc504eee7f8/users/2212397575374e2d92cdd2a68bbc5535/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:17.014742 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.015325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.015563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.041571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:17.041571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:17.135963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1252/2493] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:17.145872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:17.148407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:17.196645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:17.199051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:17.216513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc0c4-3ac3-4d25-8998-eec15e0d11e3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:17.216913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc7cf2-9da4-4444-bd9f-a0079a282212 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:17.222264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:17.222501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee01f8-fe12-4ff6-82d9-a673f63395c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:17.223124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.223411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.223522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee01f8-fe12-4ff6-82d9-a673f63395c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.223690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] PATH_INFO: `/v3/projects/fd0417a9d11e47d1a07f189a512eab0c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.223829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee01f8-fe12-4ff6-82d9-a673f63395c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.224036 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee01f8-fe12-4ff6-82d9-a673f63395c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.225045 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0417a9d11e47d1a07f189a512eab0c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:17.227397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:17.237126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee01f8-fe12-4ff6-82d9-a673f63395c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:17.238815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee01f8-fe12-4ff6-82d9-a673f63395c0 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:17.250228 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1242/2494] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:17.349927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:17.358316 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0417a9d11e47d1a07f189a512eab0c', 'request_id': 'req-a0890842-7b6b-409e-8a1b-9ce3e78293cb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:17.366512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0417a9d11e47d1a07f189a512eab0c', 'request_id': 'req-a0890842-7b6b-409e-8a1b-9ce3e78293cb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:17.372698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0417a9d11e47d1a07f189a512eab0c', 'request_id': 'req-a0890842-7b6b-409e-8a1b-9ce3e78293cb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:17.506350 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] The token cache is being invalidate because project fd0417a9d11e47d1a07f189a512eab0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:17.506897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:17.508196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-a0890842-7b6b-409e-8a1b-9ce3e78293cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:17.510152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1253/2495] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:17 2022] DELETE /identity/v3/projects/fd0417a9d11e47d1a07f189a512eab0c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:17.515567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.515887 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.516167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.525836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:17.537043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:17.539122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:17.598574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1243/2496] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:17.608214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.608511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.608791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.630139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:17.631289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:17.640328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1254/2497] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:17.644667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:17.661210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1b2e8-2e24-4057-b781-bb66a794b658 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:17.667536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:17.668209 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.668497 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.668781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.669494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:17.669847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:17.671473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:17.687185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1244/2498] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:00:17.688644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:17.703084 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d18535-e714-4a6d-a521-3470e5b13b5e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:17.705314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:17.705941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.706224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.706502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.707200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:17.709231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:17.879967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1255/2499] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:17 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:17.884941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:17.896016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27381043-677c-4200-bd5e-ce5b4ad70f79 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:17.961664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:17.996088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:17.996088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:17.996088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:17.996088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:17.996088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.141341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1245/2500] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:17 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:18.145548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.156213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9f18-5d2b-426c-b77b-7c93948336e2 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:18.160856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:18.161498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.161766 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.162051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.162764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:18.164399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.174675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1256/2501] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:18.182539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.192814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b189b7-26d5-418c-9173-d4e968e267e3 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:18.198384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7a9e-cc71-4bb8-8f45-6b303628e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:18.199002 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7a9e-cc71-4bb8-8f45-6b303628e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.199288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7a9e-cc71-4bb8-8f45-6b303628e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.199599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7a9e-cc71-4bb8-8f45-6b303628e3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.200334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7a9e-cc71-4bb8-8f45-6b303628e3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:18.201980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7a9e-cc71-4bb8-8f45-6b303628e3a9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.215177 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1246/2502] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:18.219604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.245320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146aa74-6368-4eb7-bde4-8031e583ff7d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:18.251892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:18.253041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.253351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.253648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] PATH_INFO: `/v3/projects/137dd0c0ba1f4a88a565e9173f32cdf4/users/ad9b9e6df13544b6917cd99d0888ae6f/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.285705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137dd0c0ba1f4a88a565e9173f32cdf4, user_id=ad9b9e6df13544b6917cd99d0888ae6f, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:18.289620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.407606 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1257/2503] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:18 2022] PUT /identity/v3/projects/137dd0c0ba1f4a88a565e9173f32cdf4/users/ad9b9e6df13544b6917cd99d0888ae6f/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:18.422353 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.422732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.422954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.479816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] MFA Rules not processed for user `ad9b9e6df13544b6917cd99d0888ae6f`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:18.481244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:18.519161 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.521127 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:18.593259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:18.603326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1247/2504] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:18.605570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.672687 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b65d5-d687-4126-85b4-afe79e487cf1 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:18.680341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:18.681086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.681451 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.681805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.684392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:18.691239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bda558-8ac4-4ee6-8262-7037392eb944 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:18.699345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9293afd-c333-4677-91ec-fedc32af9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:18.700622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:18.700792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9293afd-c333-4677-91ec-fedc32af9f77 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.701491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9293afd-c333-4677-91ec-fedc32af9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.701779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9293afd-c333-4677-91ec-fedc32af9f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.702803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.703421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9293afd-c333-4677-91ec-fedc32af9f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:18.708185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9293afd-c333-4677-91ec-fedc32af9f77 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.721505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1258/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:18.831146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1248/2506] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:18 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:18.832435 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.844419 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785a0f-221c-491a-8328-a9ac914402b4 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:18.877005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.877307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.877845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.897707 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:18.900300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:18.901783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:18.914105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:18.914105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:18.914105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:18.914105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:18.914489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:18.915720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:18.972238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1249/2507] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:18.992605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:18.995547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:19.001551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1259/2508] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:18 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:19.005787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:19.016888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0f07-7ab8-4a8c-9327-3febb0afd073 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:19.022496 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:19.023373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.023672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.023993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.024711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:19.026333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:19.037303 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1260/2509] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:19.041615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:19.052052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccfba7-6b90-4269-8636-fd716f11486c admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:19.059848 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:19.061477 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.061791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.062068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] PATH_INFO: `/v3/projects/56dd04aac25442ae8150e307ce7231ec/users/f1994b159fd3408192db503463eacb29/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.083536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dd04aac25442ae8150e307ce7231ec, user_id=f1994b159fd3408192db503463eacb29, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:19.086767 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:19.105646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337c7d-1b8a-423b-993c-028e661114f5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:19.111981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:19.117785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.117785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.117785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.124930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:19.126613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:19.137699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1250/2510] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:00:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:00:19.249281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1261/2511] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:19 2022] PUT /identity/v3/projects/56dd04aac25442ae8150e307ce7231ec/users/f1994b159fd3408192db503463eacb29/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:19.254035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:19.267262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04719cd-d0e0-4ef6-8459-35b813205ddb service swift] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:19.319049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:19.383382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e070598-cf24-4bd8-9731-c9e21ece620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:19.384014 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e070598-cf24-4bd8-9731-c9e21ece620d admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.384301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e070598-cf24-4bd8-9731-c9e21ece620d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.384643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e070598-cf24-4bd8-9731-c9e21ece620d admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.385543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e070598-cf24-4bd8-9731-c9e21ece620d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:19.387249 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e070598-cf24-4bd8-9731-c9e21ece620d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:19.398637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1251/2512] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:19.403132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:19.421228 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108da1d-07bd-458f-b002-63106fd9d356 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:19.429588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:19.430300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.430585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.430863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] PATH_INFO: `/v3/projects/56dd04aac25442ae8150e307ce7231ec/users/f1994b159fd3408192db503463eacb29/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.436600 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dd04aac25442ae8150e307ce7231ec, user_id=f1994b159fd3408192db503463eacb29, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:19.441224 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:19.477191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1262/2513] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:19 2022] PUT /identity/v3/projects/56dd04aac25442ae8150e307ce7231ec/users/f1994b159fd3408192db503463eacb29/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:19.478626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.479010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.479963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.537343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] MFA Rules not processed for user `f1994b159fd3408192db503463eacb29`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:19.539337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:19.637535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1252/2514] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:19.652739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:19.655179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:19.838221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060299e2-fc61-4f84-9799-b05639d01e33 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:19.849855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:19.850639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.850997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.851346 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.868004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:19.869989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:19.883567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1263/2515] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:20.100501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:20.168509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:20.170052 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:20.264269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822624-a9ae-4052-b35c-756cc4ebf9fd None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:20.269761 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:20.270440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:20.270734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:20.271659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] PATH_INFO: `/v3/users/ad9b9e6df13544b6917cd99d0888ae6f` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:20.274283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9b9e6df13544b6917cd99d0888ae6f)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:20.277173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:20.322200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252333-4bb1-4ef7-81c7-3b5bd54e7505 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:20.327857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:20.329739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:20.329739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:20.329739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:20.333326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:20.348906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:20.352612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f2019-d6c8-4e8b-b8f4-86bb517e0d94 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:20.373414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1264/2516] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:20.575403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:20.582182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9b9e6df13544b6917cd99d0888ae6f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:20.583559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9b9e6df13544b6917cd99d0888ae6f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:20.705582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9b9e6df13544b6917cd99d0888ae6f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:20.706608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9b9e6df13544b6917cd99d0888ae6f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:20.732280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9b9e6df13544b6917cd99d0888ae6f'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:20.762829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1253/2517] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:20 2022] DELETE /identity/v3/users/ad9b9e6df13544b6917cd99d0888ae6f => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:20.767518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:20.768167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:20.768642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:20.810509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:20.815970 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:20.876431 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:20.936341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1265/2518] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:20.970537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:20.972475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:21.128090 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3e5d-196c-4a11-b55b-2d4aacdc67a9 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:21.147861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:21.152983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:21.153786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:21.154848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:21.179925 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:21.181836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:21.195409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1254/2519] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:22.268268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:22.270341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:22.291146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1368a45-fecd-4b77-8655-8d13d42ebe92 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:22.298939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:22.300685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:22.300685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:22.300981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] PATH_INFO: `/v3/projects/137dd0c0ba1f4a88a565e9173f32cdf4` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:22.309334 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137dd0c0ba1f4a88a565e9173f32cdf4)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:22.310663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:22.528582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137dd0c0ba1f4a88a565e9173f32cdf4', 'request_id': 'req-4d6621f5-734b-4920-bc99-57b0414833f7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:22.558963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137dd0c0ba1f4a88a565e9173f32cdf4', 'request_id': 'req-4d6621f5-734b-4920-bc99-57b0414833f7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:22.584927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137dd0c0ba1f4a88a565e9173f32cdf4', 'request_id': 'req-4d6621f5-734b-4920-bc99-57b0414833f7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:22.689726 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] The token cache is being invalidate because project 137dd0c0ba1f4a88a565e9173f32cdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:22.689929 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:22.691404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:22.692425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1266/2520] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:22 2022] DELETE /identity/v3/projects/137dd0c0ba1f4a88a565e9173f32cdf4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:22.698631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:22.716512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922863a-99aa-40e1-b8bb-8e02251bc818 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:22.866943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:22.868257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:22.868670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:22.869064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] PATH_INFO: `/v3/users/f1994b159fd3408192db503463eacb29` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:22.871634 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1994b159fd3408192db503463eacb29)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:22.875016 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:23.218529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1994b159fd3408192db503463eacb29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:23.222578 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1994b159fd3408192db503463eacb29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:23.308795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1994b159fd3408192db503463eacb29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:23.310996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1994b159fd3408192db503463eacb29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:23.332552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:23.358647 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-c6e9fb1a-a218-4477-90b6-c04a88416df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1994b159fd3408192db503463eacb29'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:23.401553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1255/2521] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:22 2022] DELETE /identity/v3/users/f1994b159fd3408192db503463eacb29 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:24.424877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:24.439031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:24.449661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6621f5-734b-4920-bc99-57b0414833f7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:24.605501 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:24.608012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:24.608423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:24.608776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] PATH_INFO: `/v3/projects/56dd04aac25442ae8150e307ce7231ec` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:24.610557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dd04aac25442ae8150e307ce7231ec)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:24.616091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:24.806183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dd04aac25442ae8150e307ce7231ec', 'request_id': 'req-e5183732-5989-495a-95d9-ca6e254608eb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:24.836618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dd04aac25442ae8150e307ce7231ec', 'request_id': 'req-e5183732-5989-495a-95d9-ca6e254608eb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:24.848305 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:24.875853 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dd04aac25442ae8150e307ce7231ec', 'request_id': 'req-e5183732-5989-495a-95d9-ca6e254608eb'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:25.030482 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] The token cache is being invalidate because project 56dd04aac25442ae8150e307ce7231ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:25.031106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:25.032080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e5183732-5989-495a-95d9-ca6e254608eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:25.033910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1267/2522] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:24 2022] DELETE /identity/v3/projects/56dd04aac25442ae8150e307ce7231ec => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:25.041481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.041946 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.042053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.085479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:25.087454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:25.192233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1256/2523] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:25.201993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.202645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.202645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.232039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:25.233522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:25.242367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1268/2524] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:25.247028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:25.258261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7395f-ffa2-413d-a7e7-1bcddbb1b4aa None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:25.263623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:25.264608 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.264961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.265308 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.266088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:25.266481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:25.268512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:25.283809 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1257/2525] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:00:25.288237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:25.297907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b992f-6aeb-4707-84c5-951ea4317d16 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:25.314883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:25.315542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.315861 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.316147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.316844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:25.318820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:25.569387 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1269/2526] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:25 2022] POST /identity/v3/projects => generated 409 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:25.574996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:25.596443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ced99-f5c9-450a-9a42-039acf781b8f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:25.714116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:25.714994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.715161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.715409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.716104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:25.718080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:25.846557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1258/2527] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:25 2022] POST /identity/v3/users => generated 305 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:25.851461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:25.873992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9c4b-637f-4c35-b600-9b7435c59198 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:25.889408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:25.890102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.890397 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.890681 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.891412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:25.893452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:25.923693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1270/2528] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:25.927481 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:25.946803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2f39e-b789-4e0f-9bf6-032c5e9c14a8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:25.957730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa0156-8128-41a0-acc3-0b30df99ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:25.958766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa0156-8128-41a0-acc3-0b30df99ffd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:25.959236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa0156-8128-41a0-acc3-0b30df99ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:25.961563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa0156-8128-41a0-acc3-0b30df99ffd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:25.962507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa0156-8128-41a0-acc3-0b30df99ffd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:25.975215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa0156-8128-41a0-acc3-0b30df99ffd2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:26.028415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1259/2529] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:26.028780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:26.086567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2e04-9120-4a6c-abf0-50aa2c7f16cc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:26.094873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:26.095580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:26.095930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:26.096219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] PATH_INFO: `/v3/projects/3b86c2089ef6418b8124d9d86558ad36/users/fda3547d4ab4403b96132b0fa5f131c7/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:26.124488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b86c2089ef6418b8124d9d86558ad36, user_id=fda3547d4ab4403b96132b0fa5f131c7, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:26.127558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:26.295708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1271/2530] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:26 2022] PUT /identity/v3/projects/3b86c2089ef6418b8124d9d86558ad36/users/fda3547d4ab4403b96132b0fa5f131c7/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:26.330910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:26.331500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:26.332054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:26.383190 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] MFA Rules not processed for user `fda3547d4ab4403b96132b0fa5f131c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:26.384514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:26.438345 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:26.487132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1260/2531] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:26.487978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:26.648878 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59870d4-2e0b-4207-bedf-540bc1e3e6ce admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:26.666685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:26.667365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:26.667662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:26.668899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:26.668899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:26.677955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:26.797949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1272/2532] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:26 2022] POST /identity/v3/projects => generated 409 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:26.801846 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:26.831459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9800-420b-4d35-9fe0-3ca811c734f3 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:27.026602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bf2ab-ebe9-4ac2-a15d-53b913f28def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:27.027518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf2ab-ebe9-4ac2-a15d-53b913f28def admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:27.028030 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf2ab-ebe9-4ac2-a15d-53b913f28def admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:27.028471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bf2ab-ebe9-4ac2-a15d-53b913f28def admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:27.029525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf2ab-ebe9-4ac2-a15d-53b913f28def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:27.031942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bf2ab-ebe9-4ac2-a15d-53b913f28def admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:27.288580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1261/2533] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:26 2022] POST /identity/v3/users => generated 311 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:27.295232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:27.314997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700cb00-46a9-4f73-9d2e-750e23f2b1ee admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:27.324641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:27.324978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:27.325462 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:27.356787 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:27.360696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:27.361744 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:27.362166 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:27.363653 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:27.374249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:27.429086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] MFA Rules not processed for user `2212397575374e2d92cdd2a68bbc5535`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:27.444579 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:27.445325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1273/2534] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:27.445325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:27.460865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ba432-9da0-4895-a39f-971f6387b7e0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:27.473822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:27.473822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:27.473822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:27.473822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] PATH_INFO: `/v3/projects/2ee35b45c8a64159ad2222c032e62e51/users/e9d303dede354b32abf4ef65fb229f49/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:27.525065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee35b45c8a64159ad2222c032e62e51, user_id=e9d303dede354b32abf4ef65fb229f49, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:27.532370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:27.558531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1262/2535] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:27.563162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:27.564683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:27.591641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b9017-db8d-4f6e-b61b-bace3e74c169 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:27.599822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:27.601392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:27.601868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:27.602299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:27.603317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:27.606087 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:27.684761 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1274/2536] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:27 2022] PUT /identity/v3/projects/2ee35b45c8a64159ad2222c032e62e51/users/e9d303dede354b32abf4ef65fb229f49/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:27.689231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:27.748847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:27.781245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1263/2537] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:27 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:27.782714 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:27.854597 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c96bd-ba2b-4f78-b8b8-653461848e38 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:27.941129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:28.006794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114530b-a217-41fa-a689-057e174f65ce admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.017853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.018652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.018781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.019051 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.019730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.021711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.023968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.026479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.026479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.026479 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.026790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.028702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.045054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1275/2538] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:28.050178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:28.065842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ae43-15e2-4083-b4a4-b7e19922fa17 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.080684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b271-db6f-4455-9e55-7ec49420286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.081247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b271-db6f-4455-9e55-7ec49420286a admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.081536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b271-db6f-4455-9e55-7ec49420286a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.081824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b271-db6f-4455-9e55-7ec49420286a admin admin] PATH_INFO: `/v3/projects/2ee35b45c8a64159ad2222c032e62e51/users/e9d303dede354b32abf4ef65fb229f49/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.087545 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b271-db6f-4455-9e55-7ec49420286a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee35b45c8a64159ad2222c032e62e51, user_id=e9d303dede354b32abf4ef65fb229f49, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.093051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b271-db6f-4455-9e55-7ec49420286a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.111806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1276/2539] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:28 2022] PUT /identity/v3/projects/2ee35b45c8a64159ad2222c032e62e51/users/e9d303dede354b32abf4ef65fb229f49/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:28.126583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.127133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.127857 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.167172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1264/2540] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:27 2022] POST /identity/v3/users => generated 293 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:28.171388 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:28.186076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] MFA Rules not processed for user `e9d303dede354b32abf4ef65fb229f49`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:28.187785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:28.204223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433923ab-31e2-4e35-b41b-f1a866055090 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.310253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.310947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.311237 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.311515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.312322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.322964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.338111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1265/2541] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:28.339245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:28.343137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:28.361449 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1277/2542] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:28.362354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:28.367390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5532a-378b-4278-aaed-b6d8ef51a1cb admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.377942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146970b-6b5b-4727-95e7-2b3c10969717 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.384108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.384893 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.385254 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.385618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] PATH_INFO: `/v3/projects/23aae88bf8264238be77a1f31edf50f0/users/d94b39a7e76b4a29826c7379a67e2aa7/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.389358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.391618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.391618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.391618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] PATH_INFO: `/v3/users/7f54b07b4dbc4e67b44a1c3ff6d60226` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.392306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f54b07b4dbc4e67b44a1c3ff6d60226)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.394331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.410395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23aae88bf8264238be77a1f31edf50f0, user_id=d94b39a7e76b4a29826c7379a67e2aa7, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.414132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.507373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1278/2543] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:28 2022] PUT /identity/v3/projects/23aae88bf8264238be77a1f31edf50f0/users/d94b39a7e76b4a29826c7379a67e2aa7/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:28.512192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:28.514908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:28.572823 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:28.604736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f54b07b4dbc4e67b44a1c3ff6d60226'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:28.605961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f54b07b4dbc4e67b44a1c3ff6d60226'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:28.640017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd671c-ec4e-46b2-83af-db66c6cb99c9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.649805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.650551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.650850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.651133 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.699502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f54b07b4dbc4e67b44a1c3ff6d60226'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:28.700418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f54b07b4dbc4e67b44a1c3ff6d60226'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:28.729111 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f54b07b4dbc4e67b44a1c3ff6d60226'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:28.754415 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1266/2544] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:28 2022] DELETE /identity/v3/users/7f54b07b4dbc4e67b44a1c3ff6d60226 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:28.757292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:28.762171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:28.793705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.795299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.836016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1279/2545] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:28.844389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:28.912068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b824-a2cc-42a3-a960-1f9e5f1b5e59 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:28.929963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:28.930924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:28.931620 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:28.932092 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:28.932975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:28.935126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:28.949768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1267/2546] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:28.953570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:29.049847 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadff0ba-51e4-4ff1-8f66-572278a2d544 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:29.057046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:29.057780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:29.058097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:29.058446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] PATH_INFO: `/v3/projects/23aae88bf8264238be77a1f31edf50f0/users/d94b39a7e76b4a29826c7379a67e2aa7/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:29.064851 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=23aae88bf8264238be77a1f31edf50f0, user_id=d94b39a7e76b4a29826c7379a67e2aa7, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:29.067575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:29.097786 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1280/2547] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:28 2022] PUT /identity/v3/projects/23aae88bf8264238be77a1f31edf50f0/users/d94b39a7e76b4a29826c7379a67e2aa7/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:29.275726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:29.275726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:29.312509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135b39-c117-41fa-be79-688694dea581 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:29.387526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:29.389660 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:29.562888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d72a1-f486-4ca6-a8cc-2cdeb7d721ce admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:29.569599 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:29.572278 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:29.572690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:29.578852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:29.579010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:29.580204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:29.580573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:29.580927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] PATH_INFO: `/v3/projects/ec54531184694ef4a4201c006901c2d8` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:29.586901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:29.589338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec54531184694ef4a4201c006901c2d8)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:29.593518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:29.660616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:29.726310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:29.731106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae37d1-5b07-4739-85c5-8f87522cfa0d service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:29.747640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1281/2548] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:29.795735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec54531184694ef4a4201c006901c2d8', 'request_id': 'req-7f4d0548-c42b-4f38-bf27-462bf9a8346d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:29.911489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec54531184694ef4a4201c006901c2d8', 'request_id': 'req-7f4d0548-c42b-4f38-bf27-462bf9a8346d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:29.921858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec54531184694ef4a4201c006901c2d8', 'request_id': 'req-7f4d0548-c42b-4f38-bf27-462bf9a8346d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:29.949289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] The token cache is being invalidate because project ec54531184694ef4a4201c006901c2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:29.950917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:29.954507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7f4d0548-c42b-4f38-bf27-462bf9a8346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:29.966539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1268/2549] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:29 2022] DELETE /identity/v3/projects/ec54531184694ef4a4201c006901c2d8 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:29.966885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:29.967374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:29.967491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.030416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:30.031860 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:30.224105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1282/2550] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:30.232089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:30.232553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:30.232980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.298059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:30.309700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:30.351196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1269/2551] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:30.356249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:30.370592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b662d-c85d-4bbd-81bb-bdb8c619eb6c None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:30.377989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:30.382403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:30.382403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:30.382403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.382403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:30.382403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:30.384199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:30.402695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1283/2552] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:00:30.407737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:30.430774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a2368-f9a7-4306-a023-7c3eed11155f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:30.437824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:30.438983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:30.439701 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:30.440878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.445176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:30.447468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:30.582278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1270/2553] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:30 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:30.587063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:30.605300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcf47f-baf4-49b5-93ab-a4f75f3a603c admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:30.746247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:30.746883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:30.747199 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:30.747563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.748351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:30.750301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:30.869269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1284/2554] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:30 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:30.870535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:30.894486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546b16-6774-47be-9468-20d9338402da admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:30.903148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:30.903952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:30.904412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:30.905160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.906336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:30.909013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:30.926535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1271/2555] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:30.931312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:30.965160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957e3a-13cf-4079-9af5-b727b145243f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:30.971990 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582582ee-ff75-4ee3-a311-a3214e8ffaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:30.974705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582582ee-ff75-4ee3-a311-a3214e8ffaad admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:30.976723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582582ee-ff75-4ee3-a311-a3214e8ffaad admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:30.977478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582582ee-ff75-4ee3-a311-a3214e8ffaad admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:30.978834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582582ee-ff75-4ee3-a311-a3214e8ffaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:30.981402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582582ee-ff75-4ee3-a311-a3214e8ffaad admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:30.999872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1285/2556] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:31.002666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:31.016677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4293e1a-bf15-4010-8be8-f3a42d90fdf1 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:31.029004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:31.030064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:31.030770 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:31.031068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] PATH_INFO: `/v3/projects/d6c93702595b49309f4c9094d65d9158/users/23b8e444d85544bd92f503a4ef4d56c1/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:31.057460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c93702595b49309f4c9094d65d9158, user_id=23b8e444d85544bd92f503a4ef4d56c1, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:31.061740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:31.066320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:31.378762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1272/2557] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:31 2022] PUT /identity/v3/projects/d6c93702595b49309f4c9094d65d9158/users/23b8e444d85544bd92f503a4ef4d56c1/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:31.386081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:31.386374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:31.386650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:31.420461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] MFA Rules not processed for user `23b8e444d85544bd92f503a4ef4d56c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:31.421705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:31.444416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:31.499017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1286/2558] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:31.511993 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:31.513915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:31.614751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44461b-c865-44d3-9c20-e4f15820ca73 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:31.648961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efff62-e8bd-4e22-a3ec-6f8cc5ac182d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:31.650268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efff62-e8bd-4e22-a3ec-6f8cc5ac182d service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:31.650559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efff62-e8bd-4e22-a3ec-6f8cc5ac182d service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:31.650837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efff62-e8bd-4e22-a3ec-6f8cc5ac182d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:31.684326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efff62-e8bd-4e22-a3ec-6f8cc5ac182d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:31.692958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efff62-e8bd-4e22-a3ec-6f8cc5ac182d service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:31.746853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1273/2559] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:35.489170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:35.637671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15812-8d65-404c-aa65-b8be675a2f72 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:35.649595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:35.650493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:35.650879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:35.651259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] PATH_INFO: `/v3/users/23b8e444d85544bd92f503a4ef4d56c1` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:35.652942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b8e444d85544bd92f503a4ef4d56c1)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:35.655239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:36.425352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b8e444d85544bd92f503a4ef4d56c1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:36.426936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b8e444d85544bd92f503a4ef4d56c1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:36.436414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b8e444d85544bd92f503a4ef4d56c1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:36.437296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b8e444d85544bd92f503a4ef4d56c1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:36.457299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b8e444d85544bd92f503a4ef4d56c1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:36.561276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1287/2560] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:35 2022] DELETE /identity/v3/users/23b8e444d85544bd92f503a4ef4d56c1 => generated 0 bytes in 1070 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:36.565784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:36.565784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:36.565784 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:36.618721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:36.622501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:36.744449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1274/2561] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:36.756993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:36.759096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:36.853437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:36.886336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64973-c047-49e7-b319-301a8efb6fc0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:36.890468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f262a-1588-4356-beb9-9d2283b814da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:36.891185 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f262a-1588-4356-beb9-9d2283b814da service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:36.891594 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f262a-1588-4356-beb9-9d2283b814da service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:36.892129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f262a-1588-4356-beb9-9d2283b814da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:36.910473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f262a-1588-4356-beb9-9d2283b814da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:36.913457 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f262a-1588-4356-beb9-9d2283b814da service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:36.935232 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1288/2562] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:37.587545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:37.594971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:37.614338 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cac178-f052-4ca6-b45c-4c4742a7232f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:37.620726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:37.622224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:37.622607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:37.626990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] PATH_INFO: `/v3/projects/d6c93702595b49309f4c9094d65d9158` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:37.635259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c93702595b49309f4c9094d65d9158)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:37.637382 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:37.831975 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c93702595b49309f4c9094d65d9158', 'request_id': 'req-286519ef-6fae-4f8d-ba49-e1cd216b074d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:37.985074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c93702595b49309f4c9094d65d9158', 'request_id': 'req-286519ef-6fae-4f8d-ba49-e1cd216b074d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:37.994488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c93702595b49309f4c9094d65d9158', 'request_id': 'req-286519ef-6fae-4f8d-ba49-e1cd216b074d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:38.013906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] The token cache is being invalidate because project d6c93702595b49309f4c9094d65d9158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:38.014206 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:38.014943 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-286519ef-6fae-4f8d-ba49-e1cd216b074d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:38.016616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1275/2563] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:37 2022] DELETE /identity/v3/projects/d6c93702595b49309f4c9094d65d9158 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:38.023037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.023580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.023680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.050977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:38.053906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:38.167235 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1289/2564] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:38.169039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec85bc-861e-4bbf-ac9c-1ffd0674b3e2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.169332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec85bc-861e-4bbf-ac9c-1ffd0674b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.169614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec85bc-861e-4bbf-ac9c-1ffd0674b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.180018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:38.206717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fdec85bc-861e-4bbf-ac9c-1ffd0674b3e2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:38.208833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fdec85bc-861e-4bbf-ac9c-1ffd0674b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:38.229456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1276/2565] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:38.230181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:38.231706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602976a6-4326-48f5-b426-23f544359058 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.232041 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602976a6-4326-48f5-b426-23f544359058 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.232331 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602976a6-4326-48f5-b426-23f544359058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.244513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b757dd-45bb-4ce4-bbce-70817ef32cfc None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:38.251821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:38.253367 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.253768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.254156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.255478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:38.255991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:38.258930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:38.282942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-602976a6-4326-48f5-b426-23f544359058 None None] MFA Rules not processed for user `d94b39a7e76b4a29826c7379a67e2aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:38.284211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-602976a6-4326-48f5-b426-23f544359058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:38.294028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1290/2566] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:00:38.306124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:38.322188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb1e4-cdcd-45db-b850-5b835296d5af admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:38.328671 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:38.329817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.329817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.329817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.330498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:38.332702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:38.385821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1277/2567] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:38.401272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602976a6-4326-48f5-b426-23f544359058 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:38.402823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-602976a6-4326-48f5-b426-23f544359058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:38.438655 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1291/2568] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:38 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:38.444488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:38.490154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602976a6-4326-48f5-b426-23f544359058 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:38.556745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48b7c-5d1c-4852-b546-0b231291f13a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:38.562302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:38.563039 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.563324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.563715 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.570560 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:38.572610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:38.613903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:38.613903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:38.613903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:38.613903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:38.615009 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:38.672011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:38.673621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:38.687350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1278/2569] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:39.004648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1292/2570] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:38 2022] POST /identity/v3/users => generated 288 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:39.008494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.021963 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08394b4-1c8e-41d4-a3a7-3ecf16c23cf2 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.028642 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.029370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.029731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.030081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.030867 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.032674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.045457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1279/2571] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:39.049732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.062662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bad8b-596f-4084-b9de-9dc98fbfa825 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.069037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c0989-c213-40e2-b829-2f3be2676c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.070091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0989-c213-40e2-b829-2f3be2676c36 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.070517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0989-c213-40e2-b829-2f3be2676c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.070793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0989-c213-40e2-b829-2f3be2676c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.071521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c0989-c213-40e2-b829-2f3be2676c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.073152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c0989-c213-40e2-b829-2f3be2676c36 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.080380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:39.090931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1293/2572] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:39.091170 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.103744 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e828a-d6da-447f-bf26-7757e9c79911 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.109310 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.110003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.110323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.110599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] PATH_INFO: `/v3/projects/310bdc6d7bdc4d6b90e1405c5abe8e50/users/105b2fce963f41bfa0e83cd7ea45ca1e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.128405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310bdc6d7bdc4d6b90e1405c5abe8e50, user_id=105b2fce963f41bfa0e83cd7ea45ca1e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.131528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.260342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1280/2573] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:39 2022] PUT /identity/v3/projects/310bdc6d7bdc4d6b90e1405c5abe8e50/users/105b2fce963f41bfa0e83cd7ea45ca1e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:39.270996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.272275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.272546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.320328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] MFA Rules not processed for user `105b2fce963f41bfa0e83cd7ea45ca1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:39.322555 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:39.342201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:39.408201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1294/2574] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:39.414945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.522597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3b10e-018c-4da4-ab3d-03e6f37c4531 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.545655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.545655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.545655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.545655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.546063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.546063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.641959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.643615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:39.658750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e3d6e-6e5c-4ae3-9ad5-32e9f154ae70 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.664729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.665947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.665947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.666137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] PATH_INFO: `/v3/users/fda3547d4ab4403b96132b0fa5f131c7` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.671931 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda3547d4ab4403b96132b0fa5f131c7)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.673934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.680053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1281/2575] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:39 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:39.687122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.775907 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76597c-b0af-4589-a038-17b718a36c2c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.780740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.781511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.781805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.782088 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.783201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.784903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.903113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:39.912346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1282/2576] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:39 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:39.916015 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.926660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48183-e99a-441d-adcb-48bdd6ad8a3b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:39.933734 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:39.934506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:39.934888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:39.935425 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:39.936290 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:39.938007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:39.956436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda3547d4ab4403b96132b0fa5f131c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:39.957465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda3547d4ab4403b96132b0fa5f131c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:39.963094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1283/2577] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:39.967333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:39.972937 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda3547d4ab4403b96132b0fa5f131c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:39.973816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda3547d4ab4403b96132b0fa5f131c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:40.014738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f4a85cf5-008e-478f-9e80-4a18e50afd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda3547d4ab4403b96132b0fa5f131c7'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:40.016813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97c258-f50d-4d6b-b105-eb9d17228b95 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:40.024604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:40.025575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.026204 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.026652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] PATH_INFO: `/v3/projects/f05182a2be344bfd846ba8626d4303f3/users/dab8a786b0654582a452c67206f03d72/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.045627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05182a2be344bfd846ba8626d4303f3, user_id=dab8a786b0654582a452c67206f03d72, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:40.048393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:40.129465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1284/2578] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:39 2022] PUT /identity/v3/projects/f05182a2be344bfd846ba8626d4303f3/users/dab8a786b0654582a452c67206f03d72/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:40.134520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:40.136459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:40.140148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1295/2579] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:39 2022] DELETE /identity/v3/users/fda3547d4ab4403b96132b0fa5f131c7 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:40.146835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.147955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.148631 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.184796 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:40.186339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:40.218349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5141ac-e143-4551-b151-436ab82866de admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:40.268244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1296/2580] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:40.294509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:40.295938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:40.328370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:40.329174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.329589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.329978 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.331271 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:40.334515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:40.352148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1285/2581] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:40.353245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:40.355795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:40.365075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991369-f136-480e-897d-4429e15a7348 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:40.370745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e65ec-4838-4ce1-abfb-be3d56d6dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:40.371465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e65ec-4838-4ce1-abfb-be3d56d6dbba admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.371801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e65ec-4838-4ce1-abfb-be3d56d6dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.372094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e65ec-4838-4ce1-abfb-be3d56d6dbba admin admin] PATH_INFO: `/v3/projects/f05182a2be344bfd846ba8626d4303f3/users/dab8a786b0654582a452c67206f03d72/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.374301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e65ec-4838-4ce1-abfb-be3d56d6dbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05182a2be344bfd846ba8626d4303f3, user_id=dab8a786b0654582a452c67206f03d72, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:40.377440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e65ec-4838-4ce1-abfb-be3d56d6dbba admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:40.389955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1286/2582] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:40 2022] PUT /identity/v3/projects/f05182a2be344bfd846ba8626d4303f3/users/dab8a786b0654582a452c67206f03d72/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:40.401323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.402080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.402080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.403421 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f14a0-3783-4e8c-ac6e-15afd94ac777 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:40.440066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] MFA Rules not processed for user `dab8a786b0654582a452c67206f03d72`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:40.441489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:40.459819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:40.463889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.463889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.463889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.503989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:40.534418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1287/2583] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:40.542272 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:40.543925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:40.545503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:40.546932 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:40.559642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1297/2584] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:40.618320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac9cd-65b0-4414-b8a0-9c3ad0189c12 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:40.628626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:40.630515 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:40.630938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:40.632324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:40.635859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:40.720261 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:40.721762 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:40.733203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1288/2585] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:41.095913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:41.099870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:41.124604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304ca2-f8d2-4cbf-8f68-043cdd828f44 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:41.131988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:41.133034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:41.139736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:41.140824 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] PATH_INFO: `/v3/projects/3b86c2089ef6418b8124d9d86558ad36` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:41.143885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b86c2089ef6418b8124d9d86558ad36)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:41.147231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:41.307402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b86c2089ef6418b8124d9d86558ad36', 'request_id': 'req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:41.315148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b86c2089ef6418b8124d9d86558ad36', 'request_id': 'req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:41.323953 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b86c2089ef6418b8124d9d86558ad36', 'request_id': 'req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:41.445326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] The token cache is being invalidate because project 3b86c2089ef6418b8124d9d86558ad36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:41.446425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:41.448614 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-ff83c0ef-bf2e-4d09-be11-d57bafa1d54c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:41.454613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1298/2586] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:41 2022] DELETE /identity/v3/projects/3b86c2089ef6418b8124d9d86558ad36 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:41.459613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:41.477056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401f62-06e3-4800-b0a2-f6f423260805 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:41.609129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:41.609812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:41.610602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:41.610602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] PATH_INFO: `/v3/users/e9d303dede354b32abf4ef65fb229f49` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:41.611689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d303dede354b32abf4ef65fb229f49)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:41.613766 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:41.883630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:41.898837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d303dede354b32abf4ef65fb229f49'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:41.899627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d303dede354b32abf4ef65fb229f49'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:42.007659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d303dede354b32abf4ef65fb229f49'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:42.009336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d303dede354b32abf4ef65fb229f49'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:42.030715 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d303dede354b32abf4ef65fb229f49'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:42.049086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1289/2587] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:41 2022] DELETE /identity/v3/users/e9d303dede354b32abf4ef65fb229f49 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:42.375454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393334f0-7151-4ff6-99dc-db9bb028e2ef None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:42.375914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393334f0-7151-4ff6-99dc-db9bb028e2ef None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:42.375914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393334f0-7151-4ff6-99dc-db9bb028e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:42.403900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-393334f0-7151-4ff6-99dc-db9bb028e2ef None None] MFA Rules not processed for user `2212397575374e2d92cdd2a68bbc5535`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:42.404718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-393334f0-7151-4ff6-99dc-db9bb028e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:42.422488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:42.491821 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1299/2588] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:42.557788 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:42.559258 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:42.759133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728f7a5-a7cc-45cd-8ceb-ef30e8d9519d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:42.766509 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:42.767376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:42.767823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:42.768311 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] PATH_INFO: `/v3/projects/2ee35b45c8a64159ad2222c032e62e51` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:42.769921 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee35b45c8a64159ad2222c032e62e51)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:42.772224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:42.960562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee35b45c8a64159ad2222c032e62e51', 'request_id': 'req-8e283d0d-8854-4ebb-b7a7-87781526fda7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:43.070420 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee35b45c8a64159ad2222c032e62e51', 'request_id': 'req-8e283d0d-8854-4ebb-b7a7-87781526fda7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:43.077884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee35b45c8a64159ad2222c032e62e51', 'request_id': 'req-8e283d0d-8854-4ebb-b7a7-87781526fda7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:43.093327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] The token cache is being invalidate because project 2ee35b45c8a64159ad2222c032e62e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:43.093624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:43.094313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-8e283d0d-8854-4ebb-b7a7-87781526fda7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:43.096241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1290/2589] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:42 2022] DELETE /identity/v3/projects/2ee35b45c8a64159ad2222c032e62e51 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:43.101466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.101758 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.102066 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.130119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:43.131371 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:43.372219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1300/2590] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:43.373866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.374166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.374456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.403443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:43.404772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:43.414857 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1291/2591] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:43.418868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:43.429836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46102f-2e24-40ef-9963-1fd6beaa077f None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:43.434977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:43.435645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.435981 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.436408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.437207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:43.437536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:43.439837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:43.454945 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1301/2592] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:00:43.466662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:43.476307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e063448-1e7b-4ab9-a6d2-8d70b4fe2bd6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:43.481369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:43.481997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.482270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.482571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.483238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:43.485176 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:43.589244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1292/2593] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:43 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:43.590100 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:43.601897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b4794-78ec-45d7-b3a2-6cab713ba97d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:43.667610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:43.668148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.668434 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.668743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.669389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:43.671330 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:43.773502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1302/2594] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:43 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:43.777830 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:43.789141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bea501-4d0e-4bff-99c9-0f25dcb545ca admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:43.795260 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:43.796801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.797093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.797373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.798143 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:43.800128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:43.815262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1293/2595] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:43.816541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:43.827905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24286-136f-4cc3-bf43-fe150efaeb7e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:43.832833 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7ded4-afe5-404c-ac38-45fdd110ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:43.833464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7ded4-afe5-404c-ac38-45fdd110ec04 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.833733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7ded4-afe5-404c-ac38-45fdd110ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.834064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7ded4-afe5-404c-ac38-45fdd110ec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.834887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7ded4-afe5-404c-ac38-45fdd110ec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:43.836520 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7ded4-afe5-404c-ac38-45fdd110ec04 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:43.850697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1303/2596] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:43.852122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:43.857631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:43.863208 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73364-e46e-440d-8323-909aa616b647 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:43.869451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:43.870377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.870601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.870983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] PATH_INFO: `/v3/projects/e051243167564d68993f05bd4ae85462/users/bbb1c1ebb2014230bd086653aaf23b5e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:43.887718 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e051243167564d68993f05bd4ae85462, user_id=bbb1c1ebb2014230bd086653aaf23b5e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:43.890446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:43.980032 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1294/2597] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:43 2022] PUT /identity/v3/projects/e051243167564d68993f05bd4ae85462/users/bbb1c1ebb2014230bd086653aaf23b5e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:43.990930 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:43.991234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:43.991512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.020580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] MFA Rules not processed for user `bbb1c1ebb2014230bd086653aaf23b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:44.022328 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:44.040814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:44.094339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1304/2598] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:44.099037 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.164742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea85d2-1c5a-4a7f-925c-76ce6cdf1fd2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.170531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.171196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.171504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.177330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.177330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.177330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.297677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1295/2599] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:44 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:44.300016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.313825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba18d1-6a1f-4f9b-856f-975ff272bb1d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.373344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.374043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.374355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.374665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.375524 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.377887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.426154 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.428107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:44.491363 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da8b3-78aa-4f36-aec2-f16abde00976 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.495221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.495869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.496163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.496443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.498554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:44.509755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1305/2600] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:44 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:00:44.511502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.523593 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a675e17-2509-4528-ac45-e19945c57bb4 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.529609 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.536008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.536008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.536008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.536008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.536008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.547097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1306/2601] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:44.552680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.565810 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b63a6-9f3e-421d-bcfe-971227110c5f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.571200 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.571971 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.572698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.572698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.573247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.575035 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.575151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.589330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cd3c4-c964-4d16-b14e-da403a527ddc service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.592799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1307/2602] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:44.595650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.604439 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1296/2603] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:00:44.607105 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cd32-dd71-4260-a88b-559789e8b4e0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.612265 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.613027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.613409 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.613751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] PATH_INFO: `/v3/projects/a9fb75e8631942bfb3452ed52f1da948/users/7a2facfed207436d9c7543d01267e6af/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.629753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fb75e8631942bfb3452ed52f1da948, user_id=7a2facfed207436d9c7543d01267e6af, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.633075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.726118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1308/2604] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:44 2022] PUT /identity/v3/projects/a9fb75e8631942bfb3452ed52f1da948/users/7a2facfed207436d9c7543d01267e6af/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:44.737976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.741909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.741909 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.772326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:44.775623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] MFA Rules not processed for user `7a2facfed207436d9c7543d01267e6af`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:44.777133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:44.850992 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1297/2605] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:44.855595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:44.923428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b60f-8389-4bc7-b707-b71b4b7f1f0d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:44.928727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:44.929396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:44.929663 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:44.930155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:44.930740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:44.932882 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:44.938686 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:45.076772 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1309/2606] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:44 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:45.080964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.092298 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852eb3b-5a69-4d6e-9ffa-bcd3febf6f35 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.154636 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.155266 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.155553 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.155884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.156575 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.158652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.343312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1298/2607] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:45 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:45.348460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.366326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471a4c-42d0-4e68-9091-39944a5adfb8 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.371219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.372147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.372440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.372730 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.373578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.375192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.387220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1310/2608] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:45.391368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.402018 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cf653-14a7-419b-89d0-cb6c1c762370 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.407442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.408262 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.408628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.408972 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] PATH_INFO: `/v3/projects/05b7b45f394946b2a04804deb0386ec5/users/6203e257ab59411ba40d3300f26baf78/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.425773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b7b45f394946b2a04804deb0386ec5, user_id=6203e257ab59411ba40d3300f26baf78, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.429251 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.555535 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1299/2609] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:45 2022] PUT /identity/v3/projects/05b7b45f394946b2a04804deb0386ec5/users/6203e257ab59411ba40d3300f26baf78/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:45.559280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.569941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0af2c-b919-48ea-aa51-5719b6a09fa9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.572969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.575008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:45.644618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.644618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.644618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.644618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.645134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.645134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.645349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54609b09-973a-48fc-beeb-28d6eed344d7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.650007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.650632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.650915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.651269 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.653035 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:45.657107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1311/2610] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:45.661385 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.663990 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.665433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13752224-17c1-4e74-93f6-7a4a0069181e service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.673448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1257a-76b8-4126-a821-d1a89e00ca63 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.673953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1300/2611] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:45.679220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.679924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.680209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.680485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] PATH_INFO: `/v3/projects/05b7b45f394946b2a04804deb0386ec5/users/6203e257ab59411ba40d3300f26baf78/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.682436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b7b45f394946b2a04804deb0386ec5, user_id=6203e257ab59411ba40d3300f26baf78, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.685238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.696006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1312/2612] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:45 2022] PUT /identity/v3/projects/05b7b45f394946b2a04804deb0386ec5/users/6203e257ab59411ba40d3300f26baf78/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:00:45.706172 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.711875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.711875 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.732709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:45.742115 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] MFA Rules not processed for user `6203e257ab59411ba40d3300f26baf78`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:45.743455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:45.817065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1301/2613] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:45.836732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:45.907392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c8e7c-d3b8-4f2f-b4f2-f895531f2f94 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:45.914776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3e25f-47dd-4ed7-954a-7568406f2475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:45.915440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e25f-47dd-4ed7-954a-7568406f2475 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:45.915723 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e25f-47dd-4ed7-954a-7568406f2475 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:45.916037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3e25f-47dd-4ed7-954a-7568406f2475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:45.926203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3e25f-47dd-4ed7-954a-7568406f2475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:45.927676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3e25f-47dd-4ed7-954a-7568406f2475 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:45.938152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1313/2614] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:46.125976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:46.128161 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:46.141071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf2db-b10c-4060-8840-57fcbc4dda89 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:46.144889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:46.145450 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:46.145765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:46.146045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:46.206145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:46.207628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:46.217327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1302/2615] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:48.815738 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:48.816358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:48.816358 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:48.836615 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:48.837836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:48.900774 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1314/2616] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 23:00:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:48.926506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:48.928004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:49.000131 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104ecf-29a3-4800-b399-68fd4d4fb1f5 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:49.005746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b9ea-973c-407f-9280-b85fa5f42c25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:49.006541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b9ea-973c-407f-9280-b85fa5f42c25 service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:49.006831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b9ea-973c-407f-9280-b85fa5f42c25 service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:49.007113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b9ea-973c-407f-9280-b85fa5f42c25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:49.015628 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b9ea-973c-407f-9280-b85fa5f42c25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:49.017514 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b9ea-973c-407f-9280-b85fa5f42c25 service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:49.032812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1303/2617] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:00:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:00:50.819875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:50.829993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:50.942640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab08bc-7a90-4f5c-9b19-fb098242b4a2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:50.948613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:50.950076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:50.950384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:50.950885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] PATH_INFO: `/v3/users/bbb1c1ebb2014230bd086653aaf23b5e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:50.954403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb1c1ebb2014230bd086653aaf23b5e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:50.956546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:51.290355 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb1c1ebb2014230bd086653aaf23b5e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:51.291392 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb1c1ebb2014230bd086653aaf23b5e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:51.301065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb1c1ebb2014230bd086653aaf23b5e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:51.302005 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb1c1ebb2014230bd086653aaf23b5e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:51.329108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb1c1ebb2014230bd086653aaf23b5e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:51.452732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1315/2618] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:50 2022] DELETE /identity/v3/users/bbb1c1ebb2014230bd086653aaf23b5e => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:51.457193 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:51.457828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:51.460465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:51.485958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:51.487392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:51.510568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:51.595077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1304/2619] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:51.609219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:51.611079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:51.679138 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65c57-3bfb-4fa2-a052-d3a8639420fd admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:51.683735 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:51.684846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:51.685132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:51.685412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:51.696733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:51.698324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:51.711784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1316/2620] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:52.330619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:52.331711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:52.353600 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a67ce0-b2d9-4c20-ba8b-389bcf01dbf6 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:52.359081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:52.359958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:52.360435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:52.360735 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] PATH_INFO: `/v3/projects/e051243167564d68993f05bd4ae85462` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:52.362246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e051243167564d68993f05bd4ae85462)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:52.364789 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:52.478726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e051243167564d68993f05bd4ae85462', 'request_id': 'req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:52.555475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e051243167564d68993f05bd4ae85462', 'request_id': 'req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:52.562063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e051243167564d68993f05bd4ae85462', 'request_id': 'req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:52.576334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] The token cache is being invalidate because project e051243167564d68993f05bd4ae85462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:52.576768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:52.577547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:52.579233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1305/2621] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:52 2022] DELETE /identity/v3/projects/e051243167564d68993f05bd4ae85462 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:52.586734 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:52.609513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591d2c-490f-425b-84d0-0fe14c6db086 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:52.659578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:52.697004 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:52.697905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:52.698339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:52.698727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] PATH_INFO: `/v3/users/7a2facfed207436d9c7543d01267e6af` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:52.700656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2facfed207436d9c7543d01267e6af)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:52.703094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:52.999743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2facfed207436d9c7543d01267e6af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:53.000466 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2facfed207436d9c7543d01267e6af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:53.008672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2facfed207436d9c7543d01267e6af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:53.009386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2facfed207436d9c7543d01267e6af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:53.052795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2facfed207436d9c7543d01267e6af'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:53.142958 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1317/2622] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:52 2022] DELETE /identity/v3/users/7a2facfed207436d9c7543d01267e6af => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:53.784409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:53.787824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:53.812147 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b7e9-55bb-47aa-ab8d-09c439f2c7e8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:53.909232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:53.909934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:53.910370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:53.910666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] PATH_INFO: `/v3/projects/a9fb75e8631942bfb3452ed52f1da948` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:53.911958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fb75e8631942bfb3452ed52f1da948)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:53.913940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:54.050791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fb75e8631942bfb3452ed52f1da948', 'request_id': 'req-321784dd-420a-4f83-b09f-8ef118e71c57'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.053467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:54.220917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fb75e8631942bfb3452ed52f1da948', 'request_id': 'req-321784dd-420a-4f83-b09f-8ef118e71c57'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.235748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fb75e8631942bfb3452ed52f1da948', 'request_id': 'req-321784dd-420a-4f83-b09f-8ef118e71c57'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.260684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] The token cache is being invalidate because project a9fb75e8631942bfb3452ed52f1da948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:54.260953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.261602 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.263559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1306/2623] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:53 2022] DELETE /identity/v3/projects/a9fb75e8631942bfb3452ed52f1da948 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:54.268807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:54.270781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:54.306948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c371e-8958-4066-ae00-1a7610098ff6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:54.387549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:54.388246 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:54.388530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:54.388812 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] PATH_INFO: `/v3/users/6203e257ab59411ba40d3300f26baf78` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:54.390238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6203e257ab59411ba40d3300f26baf78)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:54.392420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:54.645682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6203e257ab59411ba40d3300f26baf78'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.646481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6203e257ab59411ba40d3300f26baf78'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.649257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:54.655887 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6203e257ab59411ba40d3300f26baf78'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.657719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6203e257ab59411ba40d3300f26baf78'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.682662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-79794dbe-d556-49f0-94a4-7c534ec7b82c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6203e257ab59411ba40d3300f26baf78'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:54.786145 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1318/2624] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:00:54 2022] DELETE /identity/v3/users/6203e257ab59411ba40d3300f26baf78 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:55.297758 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:55.299851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:55.320738 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321784dd-420a-4f83-b09f-8ef118e71c57 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:55.418849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:55.420046 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:55.420505 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:55.420957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] PATH_INFO: `/v3/projects/05b7b45f394946b2a04804deb0386ec5` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:55.422431 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b7b45f394946b2a04804deb0386ec5)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:55.424593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:55.548826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b7b45f394946b2a04804deb0386ec5', 'request_id': 'req-3f97cf31-e1bd-45df-aae6-34ab94a952f7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:55.622471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b7b45f394946b2a04804deb0386ec5', 'request_id': 'req-3f97cf31-e1bd-45df-aae6-34ab94a952f7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:55.630127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b7b45f394946b2a04804deb0386ec5', 'request_id': 'req-3f97cf31-e1bd-45df-aae6-34ab94a952f7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:55.643593 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] The token cache is being invalidate because project 05b7b45f394946b2a04804deb0386ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:00:55.643924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:55.644589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3f97cf31-e1bd-45df-aae6-34ab94a952f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:00:55.649424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1307/2625] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:00:55 2022] DELETE /identity/v3/projects/05b7b45f394946b2a04804deb0386ec5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:55.653074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:55.653638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:55.662116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:55.674649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:55.675983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:55.745072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1319/2626] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:00:55.753899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:55.754456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:55.754801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:55.776042 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:55.777358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:55.785765 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1308/2627] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:55.790877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:55.803190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fed8c-0588-4f8c-9833-27b5db445e79 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:55.808439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:55.840108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:55.840108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:55.840108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:55.840108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:00:55.840108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:55.840108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:55.841493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1320/2628] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:00:55.844272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:55.854757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a06a7-90b2-4ec9-aba0-b65509343437 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:55.859818 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:55.860451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:55.867552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:55.867552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:55.867552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:55.867552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:56.405429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1309/2629] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:00:55 2022] POST /identity/v3/projects => generated 367 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:56.409779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:56.423470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cbd87-623b-43a6-9e2d-7ca4ac78f2f3 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:56.526814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:56.527684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:56.528159 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:56.528537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:56.529843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:56.532321 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:56.671219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1321/2630] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:00:56 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:00:56.675568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:56.687434 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9323a-2bba-486d-a94d-fa53ac09e148 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:56.692323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:56.693554 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:56.693840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:56.694119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:56.694865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:56.696843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:56.712724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1310/2631] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:00:56.714152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:56.725249 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcffa-2f1b-4ba2-9532-b562f518af78 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:56.730108 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923af536-be4b-4cfc-afa6-785fc971f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:56.730910 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923af536-be4b-4cfc-afa6-785fc971f002 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:56.731302 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923af536-be4b-4cfc-afa6-785fc971f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:56.731704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923af536-be4b-4cfc-afa6-785fc971f002 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:56.732725 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923af536-be4b-4cfc-afa6-785fc971f002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:56.734570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923af536-be4b-4cfc-afa6-785fc971f002 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:56.746389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1322/2632] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:00:56.750729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:56.762716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30aac49-c664-4950-9808-9859a15174fa admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:56.767590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:56.768299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:56.768589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:56.768872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] PATH_INFO: `/v3/projects/7d15efcc56de4088967392adf2e41687/users/52c8ca492c6d48fbb24de01ce51ef69d/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:56.789049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d15efcc56de4088967392adf2e41687, user_id=52c8ca492c6d48fbb24de01ce51ef69d, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:56.794706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:56.895933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1311/2633] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:00:56 2022] PUT /identity/v3/projects/7d15efcc56de4088967392adf2e41687/users/52c8ca492c6d48fbb24de01ce51ef69d/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:00:56.907107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead84307-7833-458d-9629-563a98e3a686 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:56.907401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead84307-7833-458d-9629-563a98e3a686 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:56.907680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead84307-7833-458d-9629-563a98e3a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:56.935062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-ead84307-7833-458d-9629-563a98e3a686 None None] MFA Rules not processed for user `52c8ca492c6d48fbb24de01ce51ef69d`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:56.936320 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ead84307-7833-458d-9629-563a98e3a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:56.959131 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:57.004737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1323/2634] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:00:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:57.017213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:57.018957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:57.026326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:57.077905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac145bd-8eb5-446a-952d-3184ec611922 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:57.082686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e7bf-5756-45f2-9c54-977c8505a1b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:57.083497 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e7bf-5756-45f2-9c54-977c8505a1b4 service glance] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:57.084097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e7bf-5756-45f2-9c54-977c8505a1b4 service glance] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:57.084607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e7bf-5756-45f2-9c54-977c8505a1b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:57.095124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38e7bf-5756-45f2-9c54-977c8505a1b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:57.096684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38e7bf-5756-45f2-9c54-977c8505a1b4 service glance] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:57.106423 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1312/2635] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:00.959008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead84307-7833-458d-9629-563a98e3a686 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:00.960513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ead84307-7833-458d-9629-563a98e3a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:01.028093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead84307-7833-458d-9629-563a98e3a686 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:01.033398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:01.034110 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:01.034422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:01.034746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] PATH_INFO: `/v3/users/105b2fce963f41bfa0e83cd7ea45ca1e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:01.036076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105b2fce963f41bfa0e83cd7ea45ca1e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:01.038187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:01.237315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105b2fce963f41bfa0e83cd7ea45ca1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:01.237996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105b2fce963f41bfa0e83cd7ea45ca1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:01.246247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105b2fce963f41bfa0e83cd7ea45ca1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:01.246982 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105b2fce963f41bfa0e83cd7ea45ca1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:01.262551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105b2fce963f41bfa0e83cd7ea45ca1e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:01.718793 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1324/2636] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:00 2022] DELETE /identity/v3/users/105b2fce963f41bfa0e83cd7ea45ca1e => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:01.747091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:01.747091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:01.747091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:01.747091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:01.747091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:01.819107 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1313/2637] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:01.829917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:01.831372 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:01.899085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:01.903583 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88013b-b1fa-4d17-b586-9e86b763b6b6 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:01.911244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:01.912562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:01.912839 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:01.913123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:01.925928 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:01.927662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:01.941842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1325/2638] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:02.665622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:02.667072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:02.681475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd4eee-e138-47d8-9063-6610790715f7 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:02.686549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:02.687202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:02.687487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:02.687791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] PATH_INFO: `/v3/projects/310bdc6d7bdc4d6b90e1405c5abe8e50` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:02.688983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310bdc6d7bdc4d6b90e1405c5abe8e50)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:02.690994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:02.826284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310bdc6d7bdc4d6b90e1405c5abe8e50', 'request_id': 'req-7157627e-353a-44f3-8e77-8ad417bfe7e0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:02.925942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310bdc6d7bdc4d6b90e1405c5abe8e50', 'request_id': 'req-7157627e-353a-44f3-8e77-8ad417bfe7e0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:02.933026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310bdc6d7bdc4d6b90e1405c5abe8e50', 'request_id': 'req-7157627e-353a-44f3-8e77-8ad417bfe7e0'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:02.945093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] The token cache is being invalidate because project 310bdc6d7bdc4d6b90e1405c5abe8e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:02.945429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:02.946127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:02.947679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1314/2639] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:02 2022] DELETE /identity/v3/projects/310bdc6d7bdc4d6b90e1405c5abe8e50 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:02.952012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:02.975743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ff91-05fa-4eb2-a66a-b97e46b8a4c9 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:03.071157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:03.073229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:03.073229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:03.073523 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] PATH_INFO: `/v3/users/dab8a786b0654582a452c67206f03d72` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:03.079026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab8a786b0654582a452c67206f03d72)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:03.081468 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:03.323746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab8a786b0654582a452c67206f03d72'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:03.324639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab8a786b0654582a452c67206f03d72'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:03.333942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab8a786b0654582a452c67206f03d72'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:03.335167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab8a786b0654582a452c67206f03d72'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:03.352816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-9d83e6be-926a-4aae-829c-dda38a2d9bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab8a786b0654582a452c67206f03d72'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:03.467448 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1326/2640] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:02 2022] DELETE /identity/v3/users/dab8a786b0654582a452c67206f03d72 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:04.049563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:04.052299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:04.080827 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157627e-353a-44f3-8e77-8ad417bfe7e0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:04.125994 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:04.162979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:04.163641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:04.164079 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:04.164368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] PATH_INFO: `/v3/projects/f05182a2be344bfd846ba8626d4303f3` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:04.165688 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05182a2be344bfd846ba8626d4303f3)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:04.167624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:04.350327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05182a2be344bfd846ba8626d4303f3', 'request_id': 'req-a5a830d6-0d4b-4b74-8d9d-96288c0badad'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:04.437949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05182a2be344bfd846ba8626d4303f3', 'request_id': 'req-a5a830d6-0d4b-4b74-8d9d-96288c0badad'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:04.451576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05182a2be344bfd846ba8626d4303f3', 'request_id': 'req-a5a830d6-0d4b-4b74-8d9d-96288c0badad'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:04.465966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] The token cache is being invalidate because project f05182a2be344bfd846ba8626d4303f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:04.476942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:04.476942 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a5a830d6-0d4b-4b74-8d9d-96288c0badad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:04.480700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1315/2641] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:04 2022] DELETE /identity/v3/projects/f05182a2be344bfd846ba8626d4303f3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:04.483069 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:04.483565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:04.483690 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:04.507186 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:04.509197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:04.584279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1327/2642] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:04.592833 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:04.593128 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:04.593436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:04.620506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:04.631787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:04.639859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1316/2643] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:04.644902 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:04.652788 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:04.658175 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc526c-f239-46a2-89e6-6f2917a586e0 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:04.663864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:04.665870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:04.665870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:04.665870 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:04.666529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:04.666918 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:04.668841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:04.682830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1328/2644] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:04.687203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:04.702577 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89deba7-5eea-4481-a109-4f3509742ef4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:04.709390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:04.710068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:04.710491 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:04.710776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:04.711449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:04.713441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:04.834113 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1317/2645] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:04 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:04.836689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:04.846737 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb405b-296d-4325-adca-ae8df70e1935 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:04.904672 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:04.905288 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:04.905573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:04.905849 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:04.906521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:04.908513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:05.069176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1329/2646] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:04 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:05.074044 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:05.086293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6e063-a6d3-4b0d-b8d8-578c9c5ce0ab admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:05.092281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:05.092281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.092703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.092910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.093644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:05.095387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:05.126074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:05.134119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1318/2647] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:05.139255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79d63-c2b2-46d4-a224-0355e4600149 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:05.148447 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f1419-5a07-44f6-98f1-7917343a7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:05.149243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1419-5a07-44f6-98f1-7917343a7b67 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.149633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1419-5a07-44f6-98f1-7917343a7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.150016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1419-5a07-44f6-98f1-7917343a7b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.150939 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f1419-5a07-44f6-98f1-7917343a7b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:05.153333 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f1419-5a07-44f6-98f1-7917343a7b67 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:05.170791 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1330/2648] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:05.177571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:05.196609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba149edf-09f6-45b4-8199-8921a43ba3cc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:05.202662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:05.203460 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.203864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.204149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] PATH_INFO: `/v3/projects/73b4969fa1a1415daa23bf15049a044d/users/2a585b4c83be4c01b3b0d3ef80eddbb5/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.221729 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b4969fa1a1415daa23bf15049a044d, user_id=2a585b4c83be4c01b3b0d3ef80eddbb5, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:05.225064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:05.319242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1319/2649] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:05 2022] PUT /identity/v3/projects/73b4969fa1a1415daa23bf15049a044d/users/2a585b4c83be4c01b3b0d3ef80eddbb5/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:05.336696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.337459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.337952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.379616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] MFA Rules not processed for user `2a585b4c83be4c01b3b0d3ef80eddbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:05.381123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:05.480017 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1331/2650] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:05.485487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:05.599585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:05.604054 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ab83f-c5ed-4749-ac15-eab7ba323f9e admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:05.610109 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:05.610871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.611166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.611446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.612220 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:05.614084 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:05.740823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1320/2651] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:05 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:05.745716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:05.759855 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8abae-bdbf-45f7-9a9f-bbe0ab12b949 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:05.830844 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:05.831416 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.831714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.832034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.832789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:05.836198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:05.845522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:05.956470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1332/2652] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:05 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:05.961670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:05.977622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88f20-d951-4037-8687-bcce767a2d57 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:05.983804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:05.984414 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:05.984699 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:05.985212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:05.986135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:05.988076 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.001504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1321/2653] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:06.007425 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.018130 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad2dfc-fb01-4169-8f6a-ea534f27a39f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.023554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd863b4-3557-493c-93b7-d17b14447359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.024213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd863b4-3557-493c-93b7-d17b14447359 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.024550 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd863b4-3557-493c-93b7-d17b14447359 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.024830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd863b4-3557-493c-93b7-d17b14447359 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.025549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd863b4-3557-493c-93b7-d17b14447359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.027189 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd863b4-3557-493c-93b7-d17b14447359 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.037634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1333/2654] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:06.041965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.052662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4e960-8e6e-441c-aaec-ae36ffda3db0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.057406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.058093 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.058381 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.058662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] PATH_INFO: `/v3/projects/4edda8d91e9a4b14af0e909f08241638/users/8b5b415f84f141599f9930291e63516e/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.075801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edda8d91e9a4b14af0e909f08241638, user_id=8b5b415f84f141599f9930291e63516e, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.078474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.147894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1322/2655] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:06 2022] PUT /identity/v3/projects/4edda8d91e9a4b14af0e909f08241638/users/8b5b415f84f141599f9930291e63516e/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:06.159704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.160142 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.160498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.189852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] MFA Rules not processed for user `8b5b415f84f141599f9930291e63516e`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:06.191536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:06.261581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1334/2656] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:06.266267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.337802 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758fade-4e70-4eea-88b0-2d29c641f2b4 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.342856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.343371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.343662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.343980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.344657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.346613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.452856 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1323/2657] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:06 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:06.456984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.469825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972c49e-aa1a-4643-a2c2-ab1dc5b4bc32 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.531648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.532311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.532598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.532873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.533551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.535465 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.658514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1335/2658] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:06 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:06.663436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.674696 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5dd9d-e4bc-4285-9941-0300f7e3c885 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.680150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90e40-79ea-48fb-b9ea-5e251ee9d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.680767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90e40-79ea-48fb-b9ea-5e251ee9d62e admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.681077 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90e40-79ea-48fb-b9ea-5e251ee9d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.681355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90e40-79ea-48fb-b9ea-5e251ee9d62e admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.682059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad90e40-79ea-48fb-b9ea-5e251ee9d62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.683652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad90e40-79ea-48fb-b9ea-5e251ee9d62e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.694606 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1324/2659] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:06.698959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.709314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575299-c322-4397-a27b-c16718c6d2c9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.714097 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.714771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.715060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.715343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] PATH_INFO: `/v3/projects/2debd0f6ff334d59afdae4373bbdb757/users/3bf6876813e0495db18c134251d3ff03/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.734113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2debd0f6ff334d59afdae4373bbdb757, user_id=3bf6876813e0495db18c134251d3ff03, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.737586 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.782698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.782698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.782698 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.798814 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:06.800105 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:06.842513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1336/2660] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:06 2022] PUT /identity/v3/projects/2debd0f6ff334d59afdae4373bbdb757/users/3bf6876813e0495db18c134251d3ff03/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:06.846769 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.870684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1325/2661] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 25 23:01:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:06.885499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.887973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:06.900060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:06.920405 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:06.929077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2b65a-35ee-4ff7-ac2e-84be99cf1a27 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.934095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.934746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.935034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.935314 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.936054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.938947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.952223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1337/2662] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:01:06.956168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:06.968411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad18e2-b229-48f9-b0d2-eb1920cb56bb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.969227 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580562-d40e-4e2f-b5cd-288df0a30f92 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:06.976481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5808c-577a-4c88-bf9f-0989b51213a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:06.977293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5808c-577a-4c88-bf9f-0989b51213a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:06.977727 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5808c-577a-4c88-bf9f-0989b51213a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:06.978020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5808c-577a-4c88-bf9f-0989b51213a5 admin admin] PATH_INFO: `/v3/projects/2debd0f6ff334d59afdae4373bbdb757/users/3bf6876813e0495db18c134251d3ff03/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:06.980424 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5808c-577a-4c88-bf9f-0989b51213a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2debd0f6ff334d59afdae4373bbdb757, user_id=3bf6876813e0495db18c134251d3ff03, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:06.983895 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5808c-577a-4c88-bf9f-0989b51213a5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:06.996575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1338/2663] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:06 2022] PUT /identity/v3/projects/2debd0f6ff334d59afdae4373bbdb757/users/3bf6876813e0495db18c134251d3ff03/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:07.008011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:07.011634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:07.011634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:07.043304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] MFA Rules not processed for user `3bf6876813e0495db18c134251d3ff03`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:07.044716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:07.170967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1339/2664] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:07.183390 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:07.185529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:07.202882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:07.202882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:07.202882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:07.202882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:07.274992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcca7e-cc91-41ca-8f72-b5058efbcf93 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:07.281270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:07.282494 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:07.283091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:07.283408 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:07.285327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:07.287545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:07.299280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1326/2665] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:01:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:01:07.302102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:07.304261 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:07.324991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1340/2666] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:08.521324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:08.522817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:08.579202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e57f1-54a2-4001-a992-07b4208c2008 service swift] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:08.582847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:08.584200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:08.584479 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:08.584749 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:08.613873 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:08.650545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:08.653720 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:08.664384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1327/2667] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:13.751370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:13.761034 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21194bdf-4718-4b29-bbdd-ac400540ec31 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:13.764743 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:13.765351 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:13.765637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:13.765914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:13.809096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:13.825411 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:13.826943 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:13.836974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1341/2668] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:15.792135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:15.794436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:15.854705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29e3f-8da2-41de-8c27-c1fab1998b33 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:15.858327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:15.858947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:15.859234 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:15.859512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:15.861441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:15.929283 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:15.930651 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53b051-e2e4-41dd-a250-f93c91ed3e6c service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:15.940372 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1328/2669] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:01:18.159624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:18.250684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1072d9-0999-449f-bbad-e8cfa7384025 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:18.258536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:18.261685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:18.262079 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:18.262382 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] PATH_INFO: `/v3/users/2a585b4c83be4c01b3b0d3ef80eddbb5` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:18.265140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a585b4c83be4c01b3b0d3ef80eddbb5)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:18.267733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:18.463984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a585b4c83be4c01b3b0d3ef80eddbb5'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:18.464683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a585b4c83be4c01b3b0d3ef80eddbb5'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:18.471785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a585b4c83be4c01b3b0d3ef80eddbb5'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:18.478565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a585b4c83be4c01b3b0d3ef80eddbb5'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:18.492596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a585b4c83be4c01b3b0d3ef80eddbb5'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:18.578493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1342/2670] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:18 2022] DELETE /identity/v3/users/2a585b4c83be4c01b3b0d3ef80eddbb5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:18.584461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:18.596045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:18.596045 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:18.615776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:18.617318 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:18.684704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1329/2671] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:18.696704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:18.698300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:18.767394 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e19a1f-4c4e-432f-b9c2-b6e249efc80d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:18.772209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:18.772933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:18.773326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:18.773740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:18.783679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:18.785195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:18.796220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1343/2672] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:19.303860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:19.305987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:19.320438 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f52da6-0a89-49a0-9b21-b085d0c0f7d4 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:19.330745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:19.331724 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:19.332348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:19.333474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] PATH_INFO: `/v3/projects/73b4969fa1a1415daa23bf15049a044d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:19.334950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b4969fa1a1415daa23bf15049a044d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:19.337200 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:19.350951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:19.441527 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b4969fa1a1415daa23bf15049a044d', 'request_id': 'req-d592377d-2ac9-42ee-a019-ef27fd3e38b6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.503098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b4969fa1a1415daa23bf15049a044d', 'request_id': 'req-d592377d-2ac9-42ee-a019-ef27fd3e38b6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.509850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b4969fa1a1415daa23bf15049a044d', 'request_id': 'req-d592377d-2ac9-42ee-a019-ef27fd3e38b6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.523187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] The token cache is being invalidate because project 73b4969fa1a1415daa23bf15049a044d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:19.523474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.524133 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.525660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1330/2673] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:19 2022] DELETE /identity/v3/projects/73b4969fa1a1415daa23bf15049a044d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:19.529776 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:19.535806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:19.539795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2de21-6fd7-445f-b84f-f7c6819c32d4 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:19.599336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:19.600040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:19.600331 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:19.600612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] PATH_INFO: `/v3/users/8b5b415f84f141599f9930291e63516e` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:19.601794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5b415f84f141599f9930291e63516e)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:19.603712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:19.796659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5b415f84f141599f9930291e63516e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.797276 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5b415f84f141599f9930291e63516e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.805815 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5b415f84f141599f9930291e63516e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.806563 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5b415f84f141599f9930291e63516e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.819688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5b415f84f141599f9930291e63516e'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:19.892280 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1344/2674] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:19 2022] DELETE /identity/v3/users/8b5b415f84f141599f9930291e63516e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:20.326898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:20.328403 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:20.346906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592377d-2ac9-42ee-a019-ef27fd3e38b6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:20.410457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:20.411879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:20.412166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:20.412442 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] PATH_INFO: `/v3/projects/4edda8d91e9a4b14af0e909f08241638` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:20.413617 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edda8d91e9a4b14af0e909f08241638)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:20.415517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:20.600371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edda8d91e9a4b14af0e909f08241638', 'request_id': 'req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:20.873162 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edda8d91e9a4b14af0e909f08241638', 'request_id': 'req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:20.880452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edda8d91e9a4b14af0e909f08241638', 'request_id': 'req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:20.891717 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] The token cache is being invalidate because project 4edda8d91e9a4b14af0e909f08241638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:20.892019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:20.892662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:20.894370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1331/2675] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:20 2022] DELETE /identity/v3/projects/4edda8d91e9a4b14af0e909f08241638 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:20.899054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:20.900620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:20.913905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b9cf-e7d9-426b-a872-67509dd4376f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:20.972688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:20.973933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:20.973933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:20.974182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] PATH_INFO: `/v3/users/3bf6876813e0495db18c134251d3ff03` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:20.975324 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf6876813e0495db18c134251d3ff03)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:20.977270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:21.121784 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:21.246525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf6876813e0495db18c134251d3ff03'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:21.247198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf6876813e0495db18c134251d3ff03'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:21.254576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf6876813e0495db18c134251d3ff03'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:21.255126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf6876813e0495db18c134251d3ff03'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:21.266884 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0c3abb63-46a9-40fd-8f5e-5081855a1e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf6876813e0495db18c134251d3ff03'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:21.376196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1345/2676] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:20 2022] DELETE /identity/v3/users/3bf6876813e0495db18c134251d3ff03 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:21.787351 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:21.788838 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:21.803493 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbb947-cfc1-4d1e-9379-ed1c0006796c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:21.834653 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:21.865987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:21.866679 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:21.867004 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:21.867304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] PATH_INFO: `/v3/projects/2debd0f6ff334d59afdae4373bbdb757` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:21.868595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2debd0f6ff334d59afdae4373bbdb757)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:21.870552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.015238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2debd0f6ff334d59afdae4373bbdb757', 'request_id': 'req-b3787bc6-f6b6-4095-a02a-618060cf50c5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:22.080754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2debd0f6ff334d59afdae4373bbdb757', 'request_id': 'req-b3787bc6-f6b6-4095-a02a-618060cf50c5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:22.087581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2debd0f6ff334d59afdae4373bbdb757', 'request_id': 'req-b3787bc6-f6b6-4095-a02a-618060cf50c5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:22.099518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] The token cache is being invalidate because project 2debd0f6ff334d59afdae4373bbdb757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:22.099839 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:22.100486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-b3787bc6-f6b6-4095-a02a-618060cf50c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:22.102006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1332/2677] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:21 2022] DELETE /identity/v3/projects/2debd0f6ff334d59afdae4373bbdb757 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:22.109093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.114984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.114984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.130202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:22.131437 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:22.192829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1346/2678] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:22.201495 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.201786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.202064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.222726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:22.224317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:22.236212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1333/2679] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:22.237032 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.247040 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ab69-6828-4967-88b8-759a295cb5dc None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.252009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.252626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.252909 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.253184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.254003 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:22.254996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.256795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.268979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1347/2680] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:22.278333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.288394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd003bed-f048-46d4-9c59-62e9e9e33b42 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.293066 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.293674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.293953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.294221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.294906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.299934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.356622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1334/2681] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:22 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:22.360874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.371274 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aada0-a273-4422-bd02-459aa0ba808f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.433014 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.433622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.433906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.434182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.434869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.436816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.536359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1348/2682] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:22 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:22.540637 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.550977 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb4dc0-2bf8-43c6-824f-00f0cf1708ff admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.556458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.557049 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.557334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.557611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.558307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.559980 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.571091 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1335/2683] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:22.575137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.585251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21655f8-c456-4b2f-bac4-db091c600308 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.590093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec84c8c-27cf-481d-a766-92475cc0dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.590700 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84c8c-27cf-481d-a766-92475cc0dbef admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.591009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84c8c-27cf-481d-a766-92475cc0dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.591287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84c8c-27cf-481d-a766-92475cc0dbef admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.592020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec84c8c-27cf-481d-a766-92475cc0dbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.593590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec84c8c-27cf-481d-a766-92475cc0dbef admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.604255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1349/2684] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:22.608519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.619552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3290e3e-eb16-4da3-a431-b4035ac6e630 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.624292 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.624955 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.625241 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.625521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] PATH_INFO: `/v3/projects/6aee0828795b4a68964c889d7d091daf/users/dbb611abe5e14f16aaf3c417b1403864/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.641500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aee0828795b4a68964c889d7d091daf, user_id=dbb611abe5e14f16aaf3c417b1403864, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.644174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.749357 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1336/2685] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:22 2022] PUT /identity/v3/projects/6aee0828795b4a68964c889d7d091daf/users/dbb611abe5e14f16aaf3c417b1403864/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:22.763117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.763407 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.763683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.783122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:22.792581 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] MFA Rules not processed for user `dbb611abe5e14f16aaf3c417b1403864`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:22.793862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:22.861275 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1350/2686] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:22.873551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:22.875264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:22.934584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90064f9-8668-4912-b90f-ac40886c5cee admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:22.938447 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbeb409-d5ad-404b-97ed-81748a63e3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:22.939071 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb409-d5ad-404b-97ed-81748a63e3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:22.939352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb409-d5ad-404b-97ed-81748a63e3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:22.939626 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb409-d5ad-404b-97ed-81748a63e3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:22.949306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbeb409-d5ad-404b-97ed-81748a63e3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:22.959938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbeb409-d5ad-404b-97ed-81748a63e3a6 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:22.959938 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:22.960288 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1337/2687] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:23.492708 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:23.494250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:23.562118 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10603155-8ef2-4e24-aec0-502263239dc6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:23.568234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:23.569813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:23.569813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:23.569813 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] PATH_INFO: `/v3/users/52c8ca492c6d48fbb24de01ce51ef69d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:23.571363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c8ca492c6d48fbb24de01ce51ef69d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:23.573585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:23.779007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c8ca492c6d48fbb24de01ce51ef69d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:23.779662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c8ca492c6d48fbb24de01ce51ef69d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:23.786932 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c8ca492c6d48fbb24de01ce51ef69d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:23.787651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c8ca492c6d48fbb24de01ce51ef69d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:23.801610 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c8ca492c6d48fbb24de01ce51ef69d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:23.897101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1351/2688] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:23 2022] DELETE /identity/v3/users/52c8ca492c6d48fbb24de01ce51ef69d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:23.901896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:23.902410 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:23.902897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:23.923300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:23.924580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:23.986612 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1338/2689] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:23.996639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:24.001486 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:24.019711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:24.059605 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd302b74-f3df-4f82-a00d-d1239553b1a0 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:24.063578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deae8a-5cb7-485c-a971-d026d98e2d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:24.064406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deae8a-5cb7-485c-a971-d026d98e2d6c service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:24.064804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deae8a-5cb7-485c-a971-d026d98e2d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:24.065182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deae8a-5cb7-485c-a971-d026d98e2d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:24.076373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deae8a-5cb7-485c-a971-d026d98e2d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:24.077858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deae8a-5cb7-485c-a971-d026d98e2d6c service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:24.089114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1352/2690] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:24.557376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:24.558543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:24.571702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2e010-d361-4f79-9d84-678f52daa860 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:24.576291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:24.576931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:24.577212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:24.577520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] PATH_INFO: `/v3/projects/7d15efcc56de4088967392adf2e41687` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:24.578666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d15efcc56de4088967392adf2e41687)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:24.580607 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:24.699581 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d15efcc56de4088967392adf2e41687', 'request_id': 'req-28f9fbc5-0a94-4daa-aa11-53cb519d5add'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:24.770268 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d15efcc56de4088967392adf2e41687', 'request_id': 'req-28f9fbc5-0a94-4daa-aa11-53cb519d5add'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:24.776532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d15efcc56de4088967392adf2e41687', 'request_id': 'req-28f9fbc5-0a94-4daa-aa11-53cb519d5add'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:24.788259 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] The token cache is being invalidate because project 7d15efcc56de4088967392adf2e41687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:24.788556 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:24.789212 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-28f9fbc5-0a94-4daa-aa11-53cb519d5add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:24.790757 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1339/2691] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:24 2022] DELETE /identity/v3/projects/7d15efcc56de4088967392adf2e41687 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:24.795659 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:24.796253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:24.796253 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:24.816819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:24.818163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:24.880398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1353/2692] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:24.888275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:24.888605 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:24.888894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:24.911134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:24.917267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:24.921445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1340/2693] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:24.925829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:24.935459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b966c-0dbd-4d27-884b-0b8ff50fcfd3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:24.940343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:24.940994 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:24.941233 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:24.941503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:24.942243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:24.942585 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:24.944201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:24.955714 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1354/2694] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:24.960726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:24.970129 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98134d-5319-48ff-b46c-3155fa43a3c9 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:24.975914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:24.976523 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:24.976808 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:24.977085 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:24.977812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:24.979730 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:25.126854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1341/2695] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:24 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:25.131222 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:25.141858 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ecb91-6c0f-428b-a8f6-533e6fc8469e admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:25.199822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:25.200423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:25.200705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:25.200983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:25.201649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:25.203542 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:25.321627 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1355/2696] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:25 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:25.325665 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:25.337225 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c481-bb54-4818-8363-317ad5e5b173 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:25.343908 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:25.344597 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:25.349826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:25.349826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:25.349826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:25.349826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:25.358819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1342/2697] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:25.363022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:25.373977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc080b-4f9f-4f62-bfbb-d513936ffb08 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:25.382754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6493-1fd4-4dd6-9ddc-485f969b7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:25.382754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6493-1fd4-4dd6-9ddc-485f969b7e65 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:25.382754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6493-1fd4-4dd6-9ddc-485f969b7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:25.382754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6493-1fd4-4dd6-9ddc-485f969b7e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:25.383141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f6493-1fd4-4dd6-9ddc-485f969b7e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:25.384675 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f6493-1fd4-4dd6-9ddc-485f969b7e65 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:25.399057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1356/2698] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:25.403080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:25.415409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ec09c-77ac-4b6c-b2bd-d17744c4a549 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:25.418463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:25.419135 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:25.419427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:25.419705 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] PATH_INFO: `/v3/projects/0a284e0c4629417b8763ea585c512d51/users/aa050e27f066475c8f95a3d61682e4fa/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:25.434945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a284e0c4629417b8763ea585c512d51, user_id=aa050e27f066475c8f95a3d61682e4fa, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:25.437787 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:25.567601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1343/2699] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:25 2022] PUT /identity/v3/projects/0a284e0c4629417b8763ea585c512d51/users/aa050e27f066475c8f95a3d61682e4fa/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:25.583781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb24ad8-8773-4bc5-83a7-22302125cffe None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:25.583781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb24ad8-8773-4bc5-83a7-22302125cffe None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:25.583781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb24ad8-8773-4bc5-83a7-22302125cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:25.607916 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-2eb24ad8-8773-4bc5-83a7-22302125cffe None None] MFA Rules not processed for user `aa050e27f066475c8f95a3d61682e4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:25.609134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2eb24ad8-8773-4bc5-83a7-22302125cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:25.622579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:25.683046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1357/2700] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:25.694945 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:25.696676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:25.717021 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:25.754991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aadaa5-2815-4d8e-a306-702384cd1506 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:25.758897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:25.759569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:25.759890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:25.760171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:25.768567 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:25.770130 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:25.779421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1344/2701] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:27.606183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124c501-4aed-4a18-8d1c-dd2819f4e8c0 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:27.606756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124c501-4aed-4a18-8d1c-dd2819f4e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:27.606756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124c501-4aed-4a18-8d1c-dd2819f4e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:27.626635 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3124c501-4aed-4a18-8d1c-dd2819f4e8c0 None None] MFA Rules not processed for user `aa050e27f066475c8f95a3d61682e4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:27.627974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3124c501-4aed-4a18-8d1c-dd2819f4e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:27.635596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1358/2702] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:36.074891 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=18 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:37.621051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=23 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:38.546483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.547914 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:38.618248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166a6f3-7b50-4bf7-ac1f-610b5a1083a0 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.624961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.625627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.626163 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.626441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] PATH_INFO: `/v3/users/dbb611abe5e14f16aaf3c417b1403864` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.627655 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb611abe5e14f16aaf3c417b1403864)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.629614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.832517 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb611abe5e14f16aaf3c417b1403864'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:38.833124 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb611abe5e14f16aaf3c417b1403864'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:38.924644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb611abe5e14f16aaf3c417b1403864'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:38.925164 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb611abe5e14f16aaf3c417b1403864'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:38.940202 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb611abe5e14f16aaf3c417b1403864'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:38.953754 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1345/2703] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:38 2022] DELETE /identity/v3/users/dbb611abe5e14f16aaf3c417b1403864 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:38.958400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.967195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.967195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.978845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:38.980095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:39.045126 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1359/2704] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:39.056582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:39.058025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:39.137486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071c47d-3942-49eb-b32b-3884788f807a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:39.141110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a243979-397e-4f0a-8200-5c32b90a16d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:39.141819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243979-397e-4f0a-8200-5c32b90a16d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.142145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243979-397e-4f0a-8200-5c32b90a16d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.142411 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243979-397e-4f0a-8200-5c32b90a16d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.151801 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a243979-397e-4f0a-8200-5c32b90a16d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:39.153285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a243979-397e-4f0a-8200-5c32b90a16d0 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:39.163197 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1346/2705] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:39.548646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:39.550095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:39.562925 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4ca7-d04a-49a1-83c4-36b909fbb349 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:39.567611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:39.568399 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.568692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.569094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] PATH_INFO: `/v3/projects/6aee0828795b4a68964c889d7d091daf` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.570176 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aee0828795b4a68964c889d7d091daf)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:39.572842 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:39.675183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aee0828795b4a68964c889d7d091daf', 'request_id': 'req-d1e60afc-d94f-46a0-bc08-f0244e1944aa'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:39.681934 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aee0828795b4a68964c889d7d091daf', 'request_id': 'req-d1e60afc-d94f-46a0-bc08-f0244e1944aa'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:39.687638 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aee0828795b4a68964c889d7d091daf', 'request_id': 'req-d1e60afc-d94f-46a0-bc08-f0244e1944aa'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:39.777525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] The token cache is being invalidate because project 6aee0828795b4a68964c889d7d091daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:39.777825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:39.780917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-d1e60afc-d94f-46a0-bc08-f0244e1944aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:39.780917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1360/2706] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:39 2022] DELETE /identity/v3/projects/6aee0828795b4a68964c889d7d091daf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:39.785281 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.785721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.785866 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.797182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:39.844302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:39.845531 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:39.911224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1347/2707] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:39.919782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.920195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.920365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.941374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:39.942729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:39.951112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1361/2708] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:39.955360 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:39.965748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70470a-c56f-4fe3-947e-72b31cc67b02 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:39.970445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:39.971055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.971339 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.971614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.972348 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:39.972656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:39.974230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:39.986221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1348/2709] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:39.991907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.000234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9aa1f-f982-4880-a51a-fd3e4082ab9d None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.005207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.005846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.006134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.006514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.007188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.009116 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:40.110237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1362/2710] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:39 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:40.114445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.124706 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35712b33-e88a-48cd-9be7-aabb76777db8 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.183469 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.184055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.184337 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.184611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.185289 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.187244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:40.292884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1349/2711] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:40 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:40.309209 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.322669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5e0d-0cc5-449d-8c3c-96ad2c0cf06f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.327558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.328310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.328691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.329151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.329959 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.331645 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:40.345674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1363/2712] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:40.347529 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.360480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471500f3-5cae-4e95-ae3c-1f1394e349db admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.366465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06958cc8-481f-4125-a76f-7288cfa7ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.366923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958cc8-481f-4125-a76f-7288cfa7ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.367211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958cc8-481f-4125-a76f-7288cfa7ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.367496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06958cc8-481f-4125-a76f-7288cfa7ac19 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.368247 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958cc8-481f-4125-a76f-7288cfa7ac19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.369919 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06958cc8-481f-4125-a76f-7288cfa7ac19 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:40.383794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1350/2713] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:40.386719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.397487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9d89-c6ce-44e8-8049-70c2a8831ad2 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.402491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.403269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.403740 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.404107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] PATH_INFO: `/v3/projects/6c31f901a4374b75a0cedae68e3d5bf2/users/891f69a9e064414c9a9c465ca51b9f13/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.420488 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c31f901a4374b75a0cedae68e3d5bf2, user_id=891f69a9e064414c9a9c465ca51b9f13, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.423155 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:40.504396 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1364/2714] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:40 2022] PUT /identity/v3/projects/6c31f901a4374b75a0cedae68e3d5bf2/users/891f69a9e064414c9a9c465ca51b9f13/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:40.568820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.569265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.569678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.599349 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] MFA Rules not processed for user `891f69a9e064414c9a9c465ca51b9f13`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:40.601473 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:40.640774 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:40.668399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1351/2715] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:40.672965 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.694900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:40.736657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913362-113a-4059-a8c7-d07927e473df admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.741454 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.742080 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.742363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.742639 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.743309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.745257 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:40.836572 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1365/2716] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:40 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:40.840879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:40.852786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb191b-1053-467a-a3a5-275cd3df3fd8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:40.910677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:40.911302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.911587 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.911889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.912573 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:40.914547 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.032239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1352/2717] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:40 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:41.033780 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.045204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f6cf-3018-4f2e-87f7-50191fb663e2 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.050192 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.050827 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.051119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.051401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.052149 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.053989 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.066308 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1366/2718] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:41.071437 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.082216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddac92-ef07-463c-a3a5-b917873985e5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.087860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2011-3479-4001-baf8-47361575647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.088485 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2011-3479-4001-baf8-47361575647b admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.088751 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2011-3479-4001-baf8-47361575647b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.089026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2011-3479-4001-baf8-47361575647b admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.089728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2011-3479-4001-baf8-47361575647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.091320 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2011-3479-4001-baf8-47361575647b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.103820 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1353/2719] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:41.106968 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.118156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1dfeb-ad29-49e4-9278-ed4494082bcf admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.123121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.123814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.124098 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.124373 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] PATH_INFO: `/v3/projects/33101eb622984ae5bcf0dd47badba5ce/users/f15dfd542ed140ca8ac68aa5430e16f5/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.140238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33101eb622984ae5bcf0dd47badba5ce, user_id=f15dfd542ed140ca8ac68aa5430e16f5, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.143592 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.222623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1367/2720] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:41 2022] PUT /identity/v3/projects/33101eb622984ae5bcf0dd47badba5ce/users/f15dfd542ed140ca8ac68aa5430e16f5/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:41.233686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.233973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.234248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.262971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] MFA Rules not processed for user `f15dfd542ed140ca8ac68aa5430e16f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:41.264151 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:41.329034 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1354/2721] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:41.333588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.398535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d4c3e-f4e4-40db-88aa-bb03ed37ff2c admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.403327 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.404002 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.404287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.404570 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.405243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.407123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.521137 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1368/2722] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:41 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:41.525075 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.536103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f243e6e-1fcb-4950-b0df-73cbf5647f9e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.581633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:41.594702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.595332 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.595619 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.595937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.596623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.598546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.691836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1355/2723] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:41 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:41.697019 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.708107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763190a7-3b5a-40dc-be71-385bd91d16b7 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.713530 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.714240 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.714475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.714756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.715474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.717112 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.729365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1369/2724] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:41.733576 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.743813 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3a815-7e69-4d86-86c7-0416871452dc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.748441 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.749094 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.749380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.749660 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] PATH_INFO: `/v3/projects/a72f1b14774542ea9d03c101382e4998/users/590002ed40f44421bc0e4a8ce840d9b7/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.765171 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72f1b14774542ea9d03c101382e4998, user_id=590002ed40f44421bc0e4a8ce840d9b7, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.767865 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.845263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1356/2725] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:41 2022] PUT /identity/v3/projects/a72f1b14774542ea9d03c101382e4998/users/590002ed40f44421bc0e4a8ce840d9b7/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:41.849845 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.860558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eae5b-e950-45e1-bb46-e99a8ff1cb67 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.905763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:41.921352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959bad4-9b2e-4d51-b635-7f2825ab1dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.922024 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959bad4-9b2e-4d51-b635-7f2825ab1dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.928134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959bad4-9b2e-4d51-b635-7f2825ab1dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.928134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959bad4-9b2e-4d51-b635-7f2825ab1dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.928134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959bad4-9b2e-4d51-b635-7f2825ab1dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.928134 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959bad4-9b2e-4d51-b635-7f2825ab1dd7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.935103 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1370/2726] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:41.939322 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.950445 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9b80d-2f5e-4d61-9a63-a3b17983becf admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.955155 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.955837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.956126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.956404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] PATH_INFO: `/v3/projects/a72f1b14774542ea9d03c101382e4998/users/590002ed40f44421bc0e4a8ce840d9b7/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.958448 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72f1b14774542ea9d03c101382e4998, user_id=590002ed40f44421bc0e4a8ce840d9b7, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.961663 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.972157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1357/2727] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:41 2022] PUT /identity/v3/projects/a72f1b14774542ea9d03c101382e4998/users/590002ed40f44421bc0e4a8ce840d9b7/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:41.983214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.983504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.983811 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:42.013464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] MFA Rules not processed for user `590002ed40f44421bc0e4a8ce840d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:42.014689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:42.084290 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1371/2728] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:42.095750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:42.097416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:42.157019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08150-46f6-42c7-a447-242085d004d7 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:42.161229 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:42.161847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:42.162188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:42.162464 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:42.219621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:42.221083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:42.232750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1358/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:44.242219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:44.244554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:44.257044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4616bbf-20ef-411d-b230-f80b46dd1f6e None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:44.260637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:44.261248 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:44.261621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:44.261900 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:44.322503 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:44.323964 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:44.332998 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1372/2730] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:01:45.685854 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:45.695272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0eb60-ffb6-4af4-a226-b58be4e7cdc4 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:45.699300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2114c5c-dd2f-48e3-98d7-7d9bc5d98f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:45.699962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2114c5c-dd2f-48e3-98d7-7d9bc5d98f5b service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:45.700250 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2114c5c-dd2f-48e3-98d7-7d9bc5d98f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:45.701160 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2114c5c-dd2f-48e3-98d7-7d9bc5d98f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:45.716850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2114c5c-dd2f-48e3-98d7-7d9bc5d98f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:45.720558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2114c5c-dd2f-48e3-98d7-7d9bc5d98f5b service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:45.730347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1359/2731] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:46.480731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:46.482571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:46.571196 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:46.603423 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026fd9b-37fb-4a5a-ad04-6333b04a6ec0 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:46.610490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:46.611000 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:46.611604 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:46.611927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:46.618866 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:46.649041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:46.650828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:46.668049 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1373/2732] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:48.821134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfde2-30b4-4be0-9a2f-4cee790b64f1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.821589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfde2-30b4-4be0-9a2f-4cee790b64f1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.821675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cfde2-30b4-4be0-9a2f-4cee790b64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.853750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-515cfde2-30b4-4be0-9a2f-4cee790b64f1 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:48.855003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-515cfde2-30b4-4be0-9a2f-4cee790b64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:48.885427 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:48.926888 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1360/2733] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 23:01:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:48.961129 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:48.964352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:49.070009 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c8a6f-fcda-47c8-9bd8-670df248f5a9 service placement] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.075304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.075972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.076266 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.076557 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.086771 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.088462 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.097874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1374/2734] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:01:50.056831 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.057557 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.057703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.078883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:50.080340 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:50.088584 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1361/2735] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 25 23:01:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:50.101906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.113179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34fd2-8436-4366-a488-1b795f7bbfd9 service swift] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.119888 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa977361-1236-45f7-a894-33d0bd0722a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.121809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa977361-1236-45f7-a894-33d0bd0722a8 service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.121809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa977361-1236-45f7-a894-33d0bd0722a8 service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.121809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa977361-1236-45f7-a894-33d0bd0722a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.130469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa977361-1236-45f7-a894-33d0bd0722a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.132092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa977361-1236-45f7-a894-33d0bd0722a8 service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.140699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1375/2736] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:01:50.583233 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.657793 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6ea6-de74-4bcf-af57-18206d20d8c2 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.665853 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.666752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.667040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.667321 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] PATH_INFO: `/v3/users/891f69a9e064414c9a9c465ca51b9f13` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.668689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891f69a9e064414c9a9c465ca51b9f13)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.670960 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.796031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.797109 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.797616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.818697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:50.820386 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:50.830790 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1376/2737] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 25 23:01:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:50.843646 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.857117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4c2eb-bc1e-4d60-94ea-0b747711710a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.862354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739e638-ad42-41f9-acfd-2741469ff20e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.863008 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e638-ad42-41f9-acfd-2741469ff20e service swift] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.863293 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e638-ad42-41f9-acfd-2741469ff20e service swift] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.863569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e638-ad42-41f9-acfd-2741469ff20e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.872549 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739e638-ad42-41f9-acfd-2741469ff20e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.874135 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739e638-ad42-41f9-acfd-2741469ff20e service swift] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.883616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1377/2738] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:01:50.896552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891f69a9e064414c9a9c465ca51b9f13'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:50.897367 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891f69a9e064414c9a9c465ca51b9f13'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:51.017029 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891f69a9e064414c9a9c465ca51b9f13'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:51.017666 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891f69a9e064414c9a9c465ca51b9f13'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:51.032877 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891f69a9e064414c9a9c465ca51b9f13'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:51.046697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1362/2739] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:50 2022] DELETE /identity/v3/users/891f69a9e064414c9a9c465ca51b9f13 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:51.051439 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa78dcc-92cc-4a90-88b0-61e2c974cbad None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.051731 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa78dcc-92cc-4a90-88b0-61e2c974cbad None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.052048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa78dcc-92cc-4a90-88b0-61e2c974cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.071366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-0aa78dcc-92cc-4a90-88b0-61e2c974cbad None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:51.072544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0aa78dcc-92cc-4a90-88b0-61e2c974cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.138666 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1378/2740] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:51.149063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.150545 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.200649 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:51.213346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7652567-3394-4a5d-a459-8191ad27ebb5 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.217314 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.217947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.218235 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.218521 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.228899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.230350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.240307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1363/2741] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:51.555190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.555789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.556237 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.580230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] MFA Rules not processed for user `84424cb942bb42afbd8f2b4b7d704e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:51.580230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.609785 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:51.645695 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1379/2742] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 25 23:01:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:51.657776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.659166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.704908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.708992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:51.727988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1c37-bc73-4adb-b1d3-e8bb4cbc534a None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.734871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.735703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.736021 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.736299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] PATH_INFO: `/v3/projects/6c31f901a4374b75a0cedae68e3d5bf2` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.737676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c31f901a4374b75a0cedae68e3d5bf2)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.738166 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caace5-93ec-4a5c-a41b-b94d2ed69d3b service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.743124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.744590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702abbf0ba844ec99db46a7b0c54b288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.745226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.745510 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.745792 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.755031 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.756672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.765486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1364/2743] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:01:51.887642 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c31f901a4374b75a0cedae68e3d5bf2', 'request_id': 'req-f2c468a7-eb90-433c-be29-9d3ef9459757'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:51.893890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c31f901a4374b75a0cedae68e3d5bf2', 'request_id': 'req-f2c468a7-eb90-433c-be29-9d3ef9459757'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:51.900219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c31f901a4374b75a0cedae68e3d5bf2', 'request_id': 'req-f2c468a7-eb90-433c-be29-9d3ef9459757'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.024502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] The token cache is being invalidate because project 6c31f901a4374b75a0cedae68e3d5bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:52.024502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.024502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.024502 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1380/2744] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:51 2022] DELETE /identity/v3/projects/6c31f901a4374b75a0cedae68e3d5bf2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:52.026532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:52.036222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d2f2c-cf25-4fed-b072-ba55c2276a42 service swift] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:52.067587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:52.069467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:52.101959 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:52.102669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:52.102981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:52.103711 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] PATH_INFO: `/v3/users/f15dfd542ed140ca8ac68aa5430e16f5` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:52.105040 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15dfd542ed140ca8ac68aa5430e16f5)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:52.107011 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:52.157667 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c468a7-eb90-433c-be29-9d3ef9459757 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:52.160540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:52.161156 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:52.161438 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:52.161711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:52.163779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:52.175601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:52.177027 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:52.187357 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1381/2745] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:01:52.285253 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15dfd542ed140ca8ac68aa5430e16f5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.286903 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15dfd542ed140ca8ac68aa5430e16f5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.361219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15dfd542ed140ca8ac68aa5430e16f5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.362264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15dfd542ed140ca8ac68aa5430e16f5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.378455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15dfd542ed140ca8ac68aa5430e16f5'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:52.384005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:52.395849 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1365/2746] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:52 2022] DELETE /identity/v3/users/f15dfd542ed140ca8ac68aa5430e16f5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:01:53.110979 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:53.112484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:53.130974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfe251-50d5-47ad-92e8-72fa80fb6467 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:53.193770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:53.228065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:53.228065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:53.228065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:53.228336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] PATH_INFO: `/v3/projects/33101eb622984ae5bcf0dd47badba5ce` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:53.229389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33101eb622984ae5bcf0dd47badba5ce)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:53.231856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:53.344420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33101eb622984ae5bcf0dd47badba5ce', 'request_id': 'req-27fa8e87-143e-4807-a8c9-f226429b9c68'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.351104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33101eb622984ae5bcf0dd47badba5ce', 'request_id': 'req-27fa8e87-143e-4807-a8c9-f226429b9c68'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.356983 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33101eb622984ae5bcf0dd47badba5ce', 'request_id': 'req-27fa8e87-143e-4807-a8c9-f226429b9c68'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.451517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] The token cache is being invalidate because project 33101eb622984ae5bcf0dd47badba5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:53.451852 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.452497 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.454270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1382/2747] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:53 2022] DELETE /identity/v3/projects/33101eb622984ae5bcf0dd47badba5ce => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:53.458148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:53.460563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:53.473215 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f4a2d-340a-48d8-bcc5-daa69ec7444b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:53.562451 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:53.565022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:53.565022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:53.565022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] PATH_INFO: `/v3/users/590002ed40f44421bc0e4a8ce840d9b7` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:53.566006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590002ed40f44421bc0e4a8ce840d9b7)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:53.569239 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:53.757771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590002ed40f44421bc0e4a8ce840d9b7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.758380 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590002ed40f44421bc0e4a8ce840d9b7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.828618 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590002ed40f44421bc0e4a8ce840d9b7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.829538 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590002ed40f44421bc0e4a8ce840d9b7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.844361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590002ed40f44421bc0e4a8ce840d9b7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:53.858988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1366/2748] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:53 2022] DELETE /identity/v3/users/590002ed40f44421bc0e4a8ce840d9b7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:54.469739 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.472495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:54.488871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa8e87-143e-4807-a8c9-f226429b9c68 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.562618 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.563548 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.563864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.564313 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] PATH_INFO: `/v3/projects/a72f1b14774542ea9d03c101382e4998` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.565881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72f1b14774542ea9d03c101382e4998)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:54.568029 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:54.635401 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.637504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:54.652356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0c8e-78b1-41e0-8e86-433668e8e3b6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.657391 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.658352 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.658824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.659284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] PATH_INFO: `/v3/users/aa050e27f066475c8f95a3d61682e4fa` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.660876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa050e27f066475c8f95a3d61682e4fa)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:54.663507 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:54.681680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72f1b14774542ea9d03c101382e4998', 'request_id': 'req-7703e511-5610-4b3f-b232-896feede52fd'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.689936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72f1b14774542ea9d03c101382e4998', 'request_id': 'req-7703e511-5610-4b3f-b232-896feede52fd'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.697529 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72f1b14774542ea9d03c101382e4998', 'request_id': 'req-7703e511-5610-4b3f-b232-896feede52fd'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.799298 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] The token cache is being invalidate because project a72f1b14774542ea9d03c101382e4998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:54.799607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.800326 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7703e511-5610-4b3f-b232-896feede52fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.801885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1383/2749] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:54 2022] DELETE /identity/v3/projects/a72f1b14774542ea9d03c101382e4998 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:54.806826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a045089-5041-47f5-81fb-e2dcc38a6092 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.807121 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a045089-5041-47f5-81fb-e2dcc38a6092 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.807407 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a045089-5041-47f5-81fb-e2dcc38a6092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.817955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.826590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa050e27f066475c8f95a3d61682e4fa'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.827186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa050e27f066475c8f95a3d61682e4fa'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.828850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3a045089-5041-47f5-81fb-e2dcc38a6092 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:54.830081 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3a045089-5041-47f5-81fb-e2dcc38a6092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:54.898911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1384/2750] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:54.900992 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.901354 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.901698 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.908483 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa050e27f066475c8f95a3d61682e4fa'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.909931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa050e27f066475c8f95a3d61682e4fa'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.923702 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.925754 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:54.926127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-216e4484-4f9c-45b7-bd0e-d14b03b07c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa050e27f066475c8f95a3d61682e4fa'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:54.926993 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:54.937640 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1385/2751] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:54.942269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.943429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1367/2752] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:54 2022] DELETE /identity/v3/users/aa050e27f066475c8f95a3d61682e4fa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:01:54.948379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.948675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.949263 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.954461 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befee30f-2bc9-4c07-9b68-75224e8cb4c3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.968880 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:54.970123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.030065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.030700 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.030991 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.031273 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.032037 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:55.032359 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.034282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.047537 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1368/2753] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:55.052420 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1386/2754] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:55.056475 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.058621 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.060459 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.067336 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a1d7d-bf7d-4f85-88f1-6c7f6abb6f54 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.096816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.096816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.096816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.096816 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.097979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.097979 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.131835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13fe6-8af6-4438-993c-8928c9da9d5f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.135480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.136146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.136473 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.136705 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.184504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.186015 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.197865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1387/2755] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:55.284950 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1369/2756] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:55 2022] POST /identity/v3/projects => generated 397 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:55.289623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.305398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d3e2-0573-42f6-841e-9e233e08b066 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.362921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=100 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.375865 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.376596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.376920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.377255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.378056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.380231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.489569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1388/2757] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:55 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:55.491624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.510858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519276-20d6-4996-b972-824269b94c18 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.516910 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.517552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.517837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.518795 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.518933 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.522465 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.532700 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1370/2758] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:55.536987 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.549375 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27228113-b09e-4a90-a194-aa43e5c4fe6a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.554528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.555197 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.555554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.555942 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.556728 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.558422 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.569402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1389/2759] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:55.573727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.584379 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0800-f115-4c4f-b3c1-6ee9983950da admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.589953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81885535-97b1-4374-9dd8-8913115ccec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.590625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885535-97b1-4374-9dd8-8913115ccec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.590904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885535-97b1-4374-9dd8-8913115ccec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.591178 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885535-97b1-4374-9dd8-8913115ccec6 admin admin] PATH_INFO: `/v3/projects/47eb1e37d0424598b788febe5d3a2a85/users/3dea53d5b73b4a4cb529752ec46be270/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.608810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81885535-97b1-4374-9dd8-8913115ccec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eb1e37d0424598b788febe5d3a2a85, user_id=3dea53d5b73b4a4cb529752ec46be270, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.611335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81885535-97b1-4374-9dd8-8913115ccec6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.636339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.640132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.653297 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdfb9-fe2e-481a-b4a8-47848ac5347b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.659141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.659863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.660179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.666674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] PATH_INFO: `/v3/projects/0a284e0c4629417b8763ea585c512d51` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.666674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a284e0c4629417b8763ea585c512d51)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.666674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.722676 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1371/2760] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:55 2022] PUT /identity/v3/projects/47eb1e37d0424598b788febe5d3a2a85/users/3dea53d5b73b4a4cb529752ec46be270/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:55.734123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.734489 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.734837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.778674 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] MFA Rules not processed for user `3dea53d5b73b4a4cb529752ec46be270`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:55.780214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.793966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a284e0c4629417b8763ea585c512d51', 'request_id': 'req-11204ebe-207c-4dfd-9a1d-2ab238c92e86'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:55.806446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a284e0c4629417b8763ea585c512d51', 'request_id': 'req-11204ebe-207c-4dfd-9a1d-2ab238c92e86'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:55.815554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a284e0c4629417b8763ea585c512d51', 'request_id': 'req-11204ebe-207c-4dfd-9a1d-2ab238c92e86'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:55.888366 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] The token cache is being invalidate because project 0a284e0c4629417b8763ea585c512d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:55.891478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:55.891596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1372/2761] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:01:55.891685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:55.891685 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1390/2762] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:55 2022] DELETE /identity/v3/projects/0a284e0c4629417b8763ea585c512d51 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:55.905418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.907513 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.948146 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.014886 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b934a9-9af6-4fab-aab2-744bf9abd71f None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.026918 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.028043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.028496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.029631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.031528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:56.044966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.046779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.072112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1373/2763] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:56.366198 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.368628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:56.446412 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204ebe-207c-4dfd-9a1d-2ab238c92e86 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.451490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.452190 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.452475 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.452755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.454532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:56.466340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.467960 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.478026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1391/2764] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:56.513596 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.515313 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:56.584982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751de98-029b-491b-88db-3f81501fca93 service cinder] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.589563 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.590213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.590498 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.590777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] PATH_INFO: `/v3/users/b59a8ab5cdfd4dbabe6fb7c871f543e6` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.591985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59a8ab5cdfd4dbabe6fb7c871f543e6)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.593968 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.756974 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59a8ab5cdfd4dbabe6fb7c871f543e6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:56.757648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59a8ab5cdfd4dbabe6fb7c871f543e6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:56.816804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59a8ab5cdfd4dbabe6fb7c871f543e6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:56.817433 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59a8ab5cdfd4dbabe6fb7c871f543e6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:56.830753 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9177511e-a2bd-440a-bc7d-18156f6ec8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59a8ab5cdfd4dbabe6fb7c871f543e6'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:56.844375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1374/2765] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:56 2022] DELETE /identity/v3/users/b59a8ab5cdfd4dbabe6fb7c871f543e6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:01:57.129624 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.134478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c73e1-eea9-4925-a7c5-918deb518e2c service placement] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.158905 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:57.200405 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.201078 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.201368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.201649 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] PATH_INFO: `/v3/projects/44e119a573cb4a6fa330382d12c96080` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.202907 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e119a573cb4a6fa330382d12c96080)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.205169 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.316343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e119a573cb4a6fa330382d12c96080', 'request_id': 'req-60626746-6699-4a15-8bc0-f309bf7d3f5f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:57.323580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e119a573cb4a6fa330382d12c96080', 'request_id': 'req-60626746-6699-4a15-8bc0-f309bf7d3f5f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:57.329184 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e119a573cb4a6fa330382d12c96080', 'request_id': 'req-60626746-6699-4a15-8bc0-f309bf7d3f5f'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:57.400041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] The token cache is being invalidate because project 44e119a573cb4a6fa330382d12c96080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:57.400243 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:57.400933 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-60626746-6699-4a15-8bc0-f309bf7d3f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:57.402528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1392/2766] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:57 2022] DELETE /identity/v3/projects/44e119a573cb4a6fa330382d12c96080 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:57.407540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.407966 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.408312 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.427989 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:57.429192 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:57.464571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:57.489611 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1375/2767] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:57.498165 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.498460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.498745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.520817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:57.522059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:57.531281 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1393/2768] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:57.536028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.547463 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4141b-36e7-4c4a-961f-d04c851ceba0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.552246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.552783 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.553063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.559723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.559723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:57.559723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.559723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.568678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1376/2769] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:57.573912 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.584207 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e3a6f-0f12-4c0f-806b-fec3158543e4 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.589763 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.590389 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.590674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.590952 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.591644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.593629 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.682095 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1394/2770] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:57 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:57.686232 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.696913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f84e5b-8f54-4c47-8b3c-cd13ec35c05c admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.755512 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.756798 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.757089 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.757836 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.758794 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.760873 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.840330 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1377/2771] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:57 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:57.844493 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.855085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a8783-2d6e-4ed5-b1de-0556584f20cc admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.859988 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.860598 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.860883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.861164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.861890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.863487 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.874341 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1395/2772] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:57.878639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.889530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1be0a-f567-4eb6-ada5-18ea92637be2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.894568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4c8ae-59a8-49f5-a057-250554c6c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.899280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c8ae-59a8-49f5-a057-250554c6c693 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.899280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c8ae-59a8-49f5-a057-250554c6c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.899280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c8ae-59a8-49f5-a057-250554c6c693 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.899280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4c8ae-59a8-49f5-a057-250554c6c693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.899280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4c8ae-59a8-49f5-a057-250554c6c693 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.908964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1378/2773] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:01:57.913064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.923167 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc5c8c-3b6e-4d80-b83c-3f2b4fd988b3 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.927820 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.928539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.928830 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.929111 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] PATH_INFO: `/v3/projects/638de8653df14ea69e397b5c0c9c16e5/users/86820fcc0b3a45e49862979bfb5b9d02/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.944755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638de8653df14ea69e397b5c0c9c16e5, user_id=86820fcc0b3a45e49862979bfb5b9d02, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.948204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:58.011348 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1396/2774] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:01:57 2022] PUT /identity/v3/projects/638de8653df14ea69e397b5c0c9c16e5/users/86820fcc0b3a45e49862979bfb5b9d02/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:58.023440 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef550-b4ea-48c7-81d3-b5cb2aee1b7b None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:58.023740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef550-b4ea-48c7-81d3-b5cb2aee1b7b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:58.024097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef550-b4ea-48c7-81d3-b5cb2aee1b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:58.042591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-0dfef550-b4ea-48c7-81d3-b5cb2aee1b7b None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:58.043843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-0dfef550-b4ea-48c7-81d3-b5cb2aee1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:58.105571 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1379/2775] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:58.115516 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:58.118345 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:58.176374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b59e8d-be9a-47f8-a8f6-6d5cc610ed04 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:58.181673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:58.182312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:58.182595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:58.182874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:58.222862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:58.222862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:58.222862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:58.222862 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1397/2776] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:59.695981 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.696480 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.696810 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.728998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] MFA Rules not processed for user `86820fcc0b3a45e49862979bfb5b9d02`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:59.730302 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:59.775019 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:59.812768 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1380/2777] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:01:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:59.820452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.827307 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f64d-4060-43ac-bc5a-7a8d78322b79 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:59.832060 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:59.832680 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.832969 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.833247 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.833919 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:59.835850 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:59.944201 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1398/2778] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:01:59 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:59.948358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.959376 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b82ddd-8c07-4305-ba0b-47ee620a2c0a None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.020145 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.020763 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.021103 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.021429 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.022165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.024772 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.143355 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1381/2779] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:01:59 2022] POST /identity/v3/users => generated 309 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:00.147651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.158573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67a9e-6c71-4cdf-87b2-e367750cffe8 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.163255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.164091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.170120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.170120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.170120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.170120 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.178622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1399/2780] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:00.183001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.193746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68525e41-8945-4a81-9dce-9ece4d610515 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.199065 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.199811 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.200097 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.200371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] PATH_INFO: `/v3/projects/661d0153430c42e4b8b9fbde0bece6bf/users/68d5f6efdfdd47caa0322c8b1444857d/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.217935 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d0153430c42e4b8b9fbde0bece6bf, user_id=68d5f6efdfdd47caa0322c8b1444857d, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.220789 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.326064 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1382/2781] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:00 2022] PUT /identity/v3/projects/661d0153430c42e4b8b9fbde0bece6bf/users/68d5f6efdfdd47caa0322c8b1444857d/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:00.330170 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.341469 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571157e-4f6f-4301-b213-7f7fab4b24fb admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.404676 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a596-0cd1-49cf-9d9e-d765794a0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.405286 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a596-0cd1-49cf-9d9e-d765794a0ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.405567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a596-0cd1-49cf-9d9e-d765794a0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.405843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a596-0cd1-49cf-9d9e-d765794a0ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.406538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a596-0cd1-49cf-9d9e-d765794a0ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.408182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a596-0cd1-49cf-9d9e-d765794a0ee7 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.419212 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1400/2782] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:00.423490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.434904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7be0c-da5c-4b25-bc24-8835449c7cc6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.440358 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.441039 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.450287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.450287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] PATH_INFO: `/v3/projects/661d0153430c42e4b8b9fbde0bece6bf/users/68d5f6efdfdd47caa0322c8b1444857d/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.450287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d0153430c42e4b8b9fbde0bece6bf, user_id=68d5f6efdfdd47caa0322c8b1444857d, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.450287 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.458343 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1383/2783] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:00 2022] PUT /identity/v3/projects/661d0153430c42e4b8b9fbde0bece6bf/users/68d5f6efdfdd47caa0322c8b1444857d/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:01.755837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788532-5bf8-4427-8b0d-a9377daf4d51 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.756746 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788532-5bf8-4427-8b0d-a9377daf4d51 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.757571 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788532-5bf8-4427-8b0d-a9377daf4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.788797 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-4c788532-5bf8-4427-8b0d-a9377daf4d51 None None] MFA Rules not processed for user `68d5f6efdfdd47caa0322c8b1444857d`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:01.790794 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-4c788532-5bf8-4427-8b0d-a9377daf4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:01.899636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1401/2784] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:02.249226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.251226 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:02.323892 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0792f-b4d5-4242-b377-6e58dec581d2 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.328543 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.329246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.329558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.329837 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] PATH_INFO: `/v3/users/3dea53d5b73b4a4cb529752ec46be270` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.331072 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dea53d5b73b4a4cb529752ec46be270)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.333022 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.515218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.533126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dea53d5b73b4a4cb529752ec46be270'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:02.533824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dea53d5b73b4a4cb529752ec46be270'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:02.605683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dea53d5b73b4a4cb529752ec46be270'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:02.606406 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dea53d5b73b4a4cb529752ec46be270'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:02.621733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dea53d5b73b4a4cb529752ec46be270'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:02.635732 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1384/2785] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:02 2022] DELETE /identity/v3/users/3dea53d5b73b4a4cb529752ec46be270 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:02.640921 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.641219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.641498 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.666432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:02.667651 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:02.710554 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.733057 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1402/2786] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:02.743657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.745361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:02.812785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36edf72-b723-48e6-a87e-2d8da5aab712 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.816644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.817419 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.817708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.817983 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.829791 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.831265 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.841632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1385/2787] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:03.174163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.176442 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:03.256147 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fae4-2432-4de7-be4d-acdd2a66b2f3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.261335 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.261948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.262230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.262506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.264279 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:03.276778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.282753 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.283148 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.284080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:03.291967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1403/2788] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:03.318894 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016907-149a-481b-ae4e-6b16fba2e375 service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.325695 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.326530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.327214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.327641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] PATH_INFO: `/v3/projects/47eb1e37d0424598b788febe5d3a2a85` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.328991 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47eb1e37d0424598b788febe5d3a2a85)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.335937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.337244 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.337512 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:03.352873 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a083829-37c1-431e-b2a3-e2e2f0c81fdb service placement] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.357689 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.359020 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.359318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.359596 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] PATH_INFO: `/v3/users/86820fcc0b3a45e49862979bfb5b9d02` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.361010 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86820fcc0b3a45e49862979bfb5b9d02)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.362972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.510928 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eb1e37d0424598b788febe5d3a2a85', 'request_id': 'req-3b51f28a-746f-4d1a-aa70-08171d992125'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.651471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eb1e37d0424598b788febe5d3a2a85', 'request_id': 'req-3b51f28a-746f-4d1a-aa70-08171d992125'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.657704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eb1e37d0424598b788febe5d3a2a85', 'request_id': 'req-3b51f28a-746f-4d1a-aa70-08171d992125'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.670396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] The token cache is being invalidate because project 47eb1e37d0424598b788febe5d3a2a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:03.670686 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.671424 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.672947 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1386/2789] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:03 2022] DELETE /identity/v3/projects/47eb1e37d0424598b788febe5d3a2a85 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:03.697561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86820fcc0b3a45e49862979bfb5b9d02'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.698255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86820fcc0b3a45e49862979bfb5b9d02'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.707213 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86820fcc0b3a45e49862979bfb5b9d02'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.708006 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86820fcc0b3a45e49862979bfb5b9d02'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.723591 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86820fcc0b3a45e49862979bfb5b9d02'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:03.800914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1404/2790] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:03 2022] DELETE /identity/v3/users/86820fcc0b3a45e49862979bfb5b9d02 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:04.093819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.095733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:04.146656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.178841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51f28a-746f-4d1a-aa70-08171d992125 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.241017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.241669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.241951 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.242238 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] PATH_INFO: `/v3/projects/638de8653df14ea69e397b5c0c9c16e5` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.244583 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638de8653df14ea69e397b5c0c9c16e5)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.246503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.384370 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638de8653df14ea69e397b5c0c9c16e5', 'request_id': 'req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.456592 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638de8653df14ea69e397b5c0c9c16e5', 'request_id': 'req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.463570 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638de8653df14ea69e397b5c0c9c16e5', 'request_id': 'req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.475123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] The token cache is being invalidate because project 638de8653df14ea69e397b5c0c9c16e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:04.475418 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.476081 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.478707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1387/2791] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:04 2022] DELETE /identity/v3/projects/638de8653df14ea69e397b5c0c9c16e5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:04.482843 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.489038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:04.497736 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb3c28-ba3e-4938-ac59-c44b68318e3b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.540607 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.555219 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116244-4093-442b-9752-9682170d197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.555938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116244-4093-442b-9752-9682170d197e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.556230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116244-4093-442b-9752-9682170d197e admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.556513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116244-4093-442b-9752-9682170d197e admin admin] PATH_INFO: `/v3/users/68d5f6efdfdd47caa0322c8b1444857d` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.557697 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e116244-4093-442b-9752-9682170d197e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d5f6efdfdd47caa0322c8b1444857d)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.559611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e116244-4093-442b-9752-9682170d197e admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.755665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7e116244-4093-442b-9752-9682170d197e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d5f6efdfdd47caa0322c8b1444857d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.756289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7e116244-4093-442b-9752-9682170d197e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d5f6efdfdd47caa0322c8b1444857d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.763132 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7e116244-4093-442b-9752-9682170d197e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d5f6efdfdd47caa0322c8b1444857d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.763841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7e116244-4093-442b-9752-9682170d197e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d5f6efdfdd47caa0322c8b1444857d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.777343 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-7e116244-4093-442b-9752-9682170d197e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d5f6efdfdd47caa0322c8b1444857d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:04.851150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1405/2792] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:04 2022] DELETE /identity/v3/users/68d5f6efdfdd47caa0322c8b1444857d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:05.126560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.128275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:05.143486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804c05-4cfc-4832-b4a6-fdc53dc2ed83 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.202769 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.203614 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.203746 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.204056 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] PATH_INFO: `/v3/projects/661d0153430c42e4b8b9fbde0bece6bf` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.205245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] RBAC: Authorizing `identity:delete_project(project_id=661d0153430c42e4b8b9fbde0bece6bf)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.207244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.218885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.338182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661d0153430c42e4b8b9fbde0bece6bf', 'request_id': 'req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:05.410845 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661d0153430c42e4b8b9fbde0bece6bf', 'request_id': 'req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:05.417823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661d0153430c42e4b8b9fbde0bece6bf', 'request_id': 'req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:05.429224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] The token cache is being invalidate because project 661d0153430c42e4b8b9fbde0bece6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:05.429520 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:05.430883 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-fc9b43f7-1ff5-47f9-8bbb-a94ce7c6026d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:05.432526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1388/2793] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:05 2022] DELETE /identity/v3/projects/661d0153430c42e4b8b9fbde0bece6bf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:05.437517 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.443041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.443041 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.458897 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:05.460158 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:05.519869 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1406/2794] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:05.528301 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.528595 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.528876 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.548359 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:05.549580 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:05.558364 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1389/2795] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:05.562619 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.573532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a98fd-a905-4604-98f0-e9a4d475b9a3 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.578188 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.578803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.579088 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.579365 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.580106 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:05.580452 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.582048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.593986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1407/2796] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:05.598334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.608668 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d66ac-287b-47a4-81f0-874ea21ca22e None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.613377 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.613984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.614264 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.614536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.615216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.617244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.727678 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1390/2797] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:05 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:05.732150 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.742986 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722307-8ca8-484f-9124-ffb01a9ea7a2 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.789863 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.799223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.799874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.800157 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.800432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.801101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.803031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.932574 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1408/2798] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:05 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:05.936748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.947371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe77b1d-f6a5-48ec-bcc4-56f01ba1d0d3 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.952242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.958181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.958181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.958181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.958181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.958181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.966582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1391/2799] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:05.970859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.981718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e427e-2433-454a-8ba7-ada375f75904 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.986428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba4b5a-2d96-4551-ba36-975e68dbca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.987087 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba4b5a-2d96-4551-ba36-975e68dbca02 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.987417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba4b5a-2d96-4551-ba36-975e68dbca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.987696 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba4b5a-2d96-4551-ba36-975e68dbca02 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.988463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba4b5a-2d96-4551-ba36-975e68dbca02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.992648 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba4b5a-2d96-4551-ba36-975e68dbca02 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.001499 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1409/2800] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:02:06.005870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.016346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581648-ecf8-4455-bf60-5261060a98fc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.020934 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.021539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.021822 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.022099 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] PATH_INFO: `/v3/projects/f402b2779a494b8cae7a9346993635dc/users/4e71ea92762f4f19b661eff0a16eaa66/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.038546 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f402b2779a494b8cae7a9346993635dc, user_id=4e71ea92762f4f19b661eff0a16eaa66, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.042010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.155870 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1392/2801] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:06 2022] PUT /identity/v3/projects/f402b2779a494b8cae7a9346993635dc/users/4e71ea92762f4f19b661eff0a16eaa66/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:06.168706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.168977 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.169225 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.203124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] MFA Rules not processed for user `4e71ea92762f4f19b661eff0a16eaa66`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:06.204418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:06.277938 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1410/2802] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:02:06.282670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.355394 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2ce4f-b1d6-4e42-b622-a69a7f6a7407 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.360242 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.361927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.362224 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.362492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.363184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.365275 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.459217 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1393/2803] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:06 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:06.463976 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.475347 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547f784-63c6-4de0-9a2d-2ee291f50942 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.538578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.539582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.539582 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.540023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.540712 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.543363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.636304 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1411/2804] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:06 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:06.641499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.652859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db512487-f166-4b62-b6a1-54c79e346edb admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.657897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.658574 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.658817 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.659096 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.659841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.661615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.674293 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1394/2805] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:06.681443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.695711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5a0b7-3902-44fc-9982-45525442a616 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.701203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.701868 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.702152 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.702463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] PATH_INFO: `/v3/projects/7487cb7cb7e548469cd8712723dd7d0d/users/948bfe3b758e4438b8e3d5cd224c30c8/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.721046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=7487cb7cb7e548469cd8712723dd7d0d, user_id=948bfe3b758e4438b8e3d5cd224c30c8, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.723751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.823908 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1412/2806] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:06 2022] PUT /identity/v3/projects/7487cb7cb7e548469cd8712723dd7d0d/users/948bfe3b758e4438b8e3d5cd224c30c8/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:06.828144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.839879 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bc5bb-0b0e-49a7-a2a7-9bfa6362184f admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.848452 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:06.901421 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5419805-0149-4f07-84c8-cc23f60f33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.902255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5419805-0149-4f07-84c8-cc23f60f33cf admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.902721 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5419805-0149-4f07-84c8-cc23f60f33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.903392 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5419805-0149-4f07-84c8-cc23f60f33cf admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.904167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5419805-0149-4f07-84c8-cc23f60f33cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.905973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5419805-0149-4f07-84c8-cc23f60f33cf admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.918222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1395/2807] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:02:06.922536 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.933874 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb356b-e79b-4982-a7be-6aca8f500eda admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.939050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.940168 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.940463 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.940924 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] PATH_INFO: `/v3/projects/7487cb7cb7e548469cd8712723dd7d0d/users/948bfe3b758e4438b8e3d5cd224c30c8/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.942949 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7487cb7cb7e548469cd8712723dd7d0d, user_id=948bfe3b758e4438b8e3d5cd224c30c8, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.945806 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.958231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1413/2808] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:06 2022] PUT /identity/v3/projects/7487cb7cb7e548469cd8712723dd7d0d/users/948bfe3b758e4438b8e3d5cd224c30c8/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:06.969852 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.974644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.974644 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.003964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] MFA Rules not processed for user `948bfe3b758e4438b8e3d5cd224c30c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:07.005245 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:07.079601 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1396/2809] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:07.091770 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:07.093504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:07.108342 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:07.177179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54eed-ed24-42d6-b0c4-85f323770169 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:07.181163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:07.181803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.182090 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.182363 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.191661 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:07.193182 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:07.203692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1414/2810] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:07.467552 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:07.477677 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450de7be-8501-412c-a95d-7f203afb5213 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:07.481558 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73228-7eab-44a2-905e-0641fe3867d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:07.482181 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73228-7eab-44a2-905e-0641fe3867d4 service cinder] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.482467 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73228-7eab-44a2-905e-0641fe3867d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.482750 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73228-7eab-44a2-905e-0641fe3867d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.542623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db73228-7eab-44a2-905e-0641fe3867d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:07.544134 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db73228-7eab-44a2-905e-0641fe3867d4 service cinder] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:07.553086 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1397/2811] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:16.162732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:16.226072 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcbf78-f9d7-43af-ad85-036650a00d81 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:16.231251 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:16.231936 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.232229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.232510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] PATH_INFO: `/v3/users/4e71ea92762f4f19b661eff0a16eaa66` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.233702 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e71ea92762f4f19b661eff0a16eaa66)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:16.235674 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:16.419975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e71ea92762f4f19b661eff0a16eaa66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:16.420668 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e71ea92762f4f19b661eff0a16eaa66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:16.427662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e71ea92762f4f19b661eff0a16eaa66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:16.428323 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e71ea92762f4f19b661eff0a16eaa66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:16.441026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e71ea92762f4f19b661eff0a16eaa66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:16.502210 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1415/2812] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:16 2022] DELETE /identity/v3/users/4e71ea92762f4f19b661eff0a16eaa66 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:16.506847 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.507354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.507455 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.528589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:16.529829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:16.560141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:16.594906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1398/2813] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:16.604875 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:16.606329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:16.621755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:16.667455 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515324-a263-48d3-9494-174c341ab6cf admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:16.671296 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:16.671890 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.672183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.672464 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.682920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:16.684480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:16.694376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1416/2814] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:17.080970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.082389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:17.098297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02537af-a27d-4507-a3c0-30255ffe3ca5 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.104840 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.105604 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.105898 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.106053 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] PATH_INFO: `/v3/projects/f402b2779a494b8cae7a9346993635dc` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.107257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f402b2779a494b8cae7a9346993635dc)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.109216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.242758 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f402b2779a494b8cae7a9346993635dc', 'request_id': 'req-627e137b-e911-4d2c-aea4-70dcb5e71507'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.342511 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f402b2779a494b8cae7a9346993635dc', 'request_id': 'req-627e137b-e911-4d2c-aea4-70dcb5e71507'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.349368 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f402b2779a494b8cae7a9346993635dc', 'request_id': 'req-627e137b-e911-4d2c-aea4-70dcb5e71507'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.362341 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] The token cache is being invalidate because project f402b2779a494b8cae7a9346993635dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:17.364683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.364683 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.365499 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1399/2815] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:17 2022] DELETE /identity/v3/projects/f402b2779a494b8cae7a9346993635dc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:17.369683 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.380265 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b724a7-622c-477e-95bd-4cf20f3830af service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.438443 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.439092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.439381 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.439662 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] PATH_INFO: `/v3/users/948bfe3b758e4438b8e3d5cd224c30c8` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.440879 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] RBAC: Authorizing `identity:delete_user(user_id=948bfe3b758e4438b8e3d5cd224c30c8)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.442805 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.612510 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948bfe3b758e4438b8e3d5cd224c30c8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.613180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948bfe3b758e4438b8e3d5cd224c30c8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.620238 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948bfe3b758e4438b8e3d5cd224c30c8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.620889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948bfe3b758e4438b8e3d5cd224c30c8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.633616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-e8cf7220-c06e-4c62-901d-58d897ce423f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948bfe3b758e4438b8e3d5cd224c30c8'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:17.707896 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1417/2816] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:17 2022] DELETE /identity/v3/users/948bfe3b758e4438b8e3d5cd224c30c8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:18.121722 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.123362 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:18.137347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e137b-e911-4d2c-aea4-70dcb5e71507 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.194926 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.196110 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.196396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.196675 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] PATH_INFO: `/v3/projects/7487cb7cb7e548469cd8712723dd7d0d` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.197915 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7487cb7cb7e548469cd8712723dd7d0d)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.199882 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.321940 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7487cb7cb7e548469cd8712723dd7d0d', 'request_id': 'req-1e9917ab-f698-4cbf-ba34-55445afb7710'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:18.411333 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7487cb7cb7e548469cd8712723dd7d0d', 'request_id': 'req-1e9917ab-f698-4cbf-ba34-55445afb7710'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:18.412824 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:18.418494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7487cb7cb7e548469cd8712723dd7d0d', 'request_id': 'req-1e9917ab-f698-4cbf-ba34-55445afb7710'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:18.430270 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] The token cache is being invalidate because project 7487cb7cb7e548469cd8712723dd7d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:18.430540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:18.431186 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-1e9917ab-f698-4cbf-ba34-55445afb7710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:18.432708 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1400/2817] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:18 2022] DELETE /identity/v3/projects/7487cb7cb7e548469cd8712723dd7d0d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:18.437664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.443565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.443565 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.457590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:18.458800 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:18.492587 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:18.521528 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1418/2818] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:02:18.530656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.530944 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.531214 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.552549 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:18.553848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:18.562937 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1401/2819] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:18.567398 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.577745 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e8590-9d97-40df-a9af-a86ee7e5fb44 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.582407 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.583023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.583301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.583580 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] PATH_INFO: `/v3/domains` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.584319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:18.584626 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.586311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.597972 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1419/2820] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:18.602897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.612373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b630c-ae53-469f-bd2b-1a7b6e8ec1c8 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.618033 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.618646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.618931 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.619210 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.619930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.621917 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.744132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1402/2821] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:18 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:02:18.748268 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.758817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e955bd8-96a3-4422-8e7b-62580946468d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.815414 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.816075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.816364 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.816644 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.817453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.819377 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.931325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1420/2822] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:18 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:18.935872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.946591 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef217-9bc0-48ab-a592-538b96e81b9d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.951304 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.951957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.952246 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.952525 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.953231 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.954858 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.965843 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1403/2823] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:18.969881 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.980632 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4fc01-93e0-4579-a140-7dbad173e029 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.985623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc469b-f5bd-4caf-824f-a40440938f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.986223 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc469b-f5bd-4caf-824f-a40440938f7d admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.986506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc469b-f5bd-4caf-824f-a40440938f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.986781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc469b-f5bd-4caf-824f-a40440938f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.987474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc469b-f5bd-4caf-824f-a40440938f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.989093 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc469b-f5bd-4caf-824f-a40440938f7d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.999684 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1421/2824] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:19.004144 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.014201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16092869-64ba-4e40-9c98-6f983c2a965a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.018716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.019373 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] REQUEST_METHOD: `PUT` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.019657 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.019971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] PATH_INFO: `/v3/projects/0e7e336f43a24696bad9d9204533c3b2/users/e5694dd5c6184dc1becef60363e75263/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.035007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7e336f43a24696bad9d9204533c3b2, user_id=e5694dd5c6184dc1becef60363e75263, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.037709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.106803 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1404/2825] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:19 2022] PUT /identity/v3/projects/0e7e336f43a24696bad9d9204533c3b2/users/e5694dd5c6184dc1becef60363e75263/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:19.117195 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.117483 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.117764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.146194 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] MFA Rules not processed for user `e5694dd5c6184dc1becef60363e75263`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:19.147417 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:19.212096 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1422/2826] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:19.217006 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.278201 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84880d13-28b4-40a6-9dc7-b1710709affa admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.282790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.283416 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.283697 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.283997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] PATH_INFO: `/v3/projects` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.284661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.286559 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.368323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1405/2827] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:19 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:19.371059 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.382216 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c6931-26c4-450b-8f91-bed2c88281c6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.412446 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:19.440578 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.441239 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.441492 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.441756 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] PATH_INFO: `/v3/users` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.442476 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.444436 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.523384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1423/2828] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:19 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:02:19.527472 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.538223 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa0606-d269-4eb7-8ba1-44809c3d244b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.543028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.543641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.543954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.544291 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.544984 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.546589 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.557781 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1406/2829] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:19.561955 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.572920 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f91c0-79fc-4806-9302-c12fef3eefce admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.577623 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.578289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.578576 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.578856 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] PATH_INFO: `/v3/projects/c0297cf25d6a412c972afecbdf21b127/users/1e99033f41b14dd6aa9f37d9c93cda67/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.593589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0297cf25d6a412c972afecbdf21b127, user_id=1e99033f41b14dd6aa9f37d9c93cda67, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.596264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.666699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1424/2830] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:19 2022] PUT /identity/v3/projects/c0297cf25d6a412c972afecbdf21b127/users/1e99033f41b14dd6aa9f37d9c93cda67/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:19.670779 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.681457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba7654-392b-41cf-9263-98abdd1b480a admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.731985 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:19.738496 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcba34d-ac00-4a5d-a97d-a06a1deb287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.739119 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcba34d-ac00-4a5d-a97d-a06a1deb287e admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.739404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcba34d-ac00-4a5d-a97d-a06a1deb287e admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.739682 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcba34d-ac00-4a5d-a97d-a06a1deb287e admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.740426 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcba34d-ac00-4a5d-a97d-a06a1deb287e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.742896 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcba34d-ac00-4a5d-a97d-a06a1deb287e admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.752890 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1407/2831] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:19.757284 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.769144 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f92440-28a1-4eaa-87c5-0766cc87227d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.773837 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.774513 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.774798 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.775076 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] PATH_INFO: `/v3/projects/c0297cf25d6a412c972afecbdf21b127/users/1e99033f41b14dd6aa9f37d9c93cda67/roles/bd1b5227e66846ed80031017e70bdd5c` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.777102 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0297cf25d6a412c972afecbdf21b127, user_id=1e99033f41b14dd6aa9f37d9c93cda67, role_id=bd1b5227e66846ed80031017e70bdd5c)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.779901 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.790719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1425/2832] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:19 2022] PUT /identity/v3/projects/c0297cf25d6a412c972afecbdf21b127/users/1e99033f41b14dd6aa9f37d9c93cda67/roles/bd1b5227e66846ed80031017e70bdd5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:19.801173 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.801470 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.801752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.831777 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] MFA Rules not processed for user `1e99033f41b14dd6aa9f37d9c93cda67`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:19.833008 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:19.904165 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1408/2833] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:19.916047 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.917768 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:19.976539 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838d556-3316-46c2-875a-33bd6b09d0ab admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.980260 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3eda-b663-4857-afbe-0ab9440eef83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.980973 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3eda-b663-4857-afbe-0ab9440eef83 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.981173 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3eda-b663-4857-afbe-0ab9440eef83 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.981453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3eda-b663-4857-afbe-0ab9440eef83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.991289 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3eda-b663-4857-afbe-0ab9440eef83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.993480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3eda-b663-4857-afbe-0ab9440eef83 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.003783 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1426/2834] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:21.163399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.224707 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0a952-d5c1-44ea-83a5-c32bdde94368 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.229329 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.229957 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.230243 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.230542 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] PATH_INFO: `/v3/users/e5694dd5c6184dc1becef60363e75263` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.231727 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5694dd5c6184dc1becef60363e75263)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:21.233692 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:21.451285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5694dd5c6184dc1becef60363e75263'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:21.451964 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5694dd5c6184dc1becef60363e75263'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:21.530361 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5694dd5c6184dc1becef60363e75263'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:21.530913 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5694dd5c6184dc1becef60363e75263'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:21.545203 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5694dd5c6184dc1becef60363e75263'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:21.550393 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:21.558723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1409/2835] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:21 2022] DELETE /identity/v3/users/e5694dd5c6184dc1becef60363e75263 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:21.563287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.563834 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.564086 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.582947 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:21.584214 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:21.644491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1427/2836] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:21.655167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.656631 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:21.714123 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed044-5ff4-47ae-a1e8-66b60e69e019 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.717731 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.718350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.718639 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.718927 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.728680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:21.730114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:21.739785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1410/2837] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:22.151376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:22.152978 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:22.165456 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27c587-28d0-4cfc-88ec-21a09c39c5c6 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:22.171151 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:22.177143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:22.177143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:22.177143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] PATH_INFO: `/v3/projects/0e7e336f43a24696bad9d9204533c3b2` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.177143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7e336f43a24696bad9d9204533c3b2)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:22.177143 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:22.202395 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:22.262669 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7e336f43a24696bad9d9204533c3b2', 'request_id': 'req-460221e5-078c-4c86-a69d-d603b752192a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.269311 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7e336f43a24696bad9d9204533c3b2', 'request_id': 'req-460221e5-078c-4c86-a69d-d603b752192a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.275974 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7e336f43a24696bad9d9204533c3b2', 'request_id': 'req-460221e5-078c-4c86-a69d-d603b752192a'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.325077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] The token cache is being invalidate because project 0e7e336f43a24696bad9d9204533c3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:22.325388 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.326016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.327537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1428/2838] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:22 2022] DELETE /identity/v3/projects/0e7e336f43a24696bad9d9204533c3b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:22.331641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:22.342503 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f96aca-0a34-4c0e-b230-67487fb7217d service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:22.400490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:22.401078 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:22.401365 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:22.401641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] PATH_INFO: `/v3/users/1e99033f41b14dd6aa9f37d9c93cda67` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.402826 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e99033f41b14dd6aa9f37d9c93cda67)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:22.404805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:22.555371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e99033f41b14dd6aa9f37d9c93cda67'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.556656 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e99033f41b14dd6aa9f37d9c93cda67'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.614590 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e99033f41b14dd6aa9f37d9c93cda67'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.615219 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e99033f41b14dd6aa9f37d9c93cda67'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.628800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-6e5bf8b8-7249-439e-9956-b8d3457eaf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e99033f41b14dd6aa9f37d9c93cda67'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:22.641958 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1411/2839] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:22 2022] DELETE /identity/v3/users/1e99033f41b14dd6aa9f37d9c93cda67 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:23.081148 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.082946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:23.096625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460221e5-078c-4c86-a69d-d603b752192a admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.157252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.157946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.158234 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.158540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] PATH_INFO: `/v3/projects/c0297cf25d6a412c972afecbdf21b127` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.159750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0297cf25d6a412c972afecbdf21b127)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.161692 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.282562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0297cf25d6a412c972afecbdf21b127', 'request_id': 'req-661a5cbd-854b-4a0b-995a-e9abac3fc322'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:23.288963 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0297cf25d6a412c972afecbdf21b127', 'request_id': 'req-661a5cbd-854b-4a0b-995a-e9abac3fc322'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:23.295480 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0297cf25d6a412c972afecbdf21b127', 'request_id': 'req-661a5cbd-854b-4a0b-995a-e9abac3fc322'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:23.370558 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] The token cache is being invalidate because project c0297cf25d6a412c972afecbdf21b127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:23.370877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:23.371505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-661a5cbd-854b-4a0b-995a-e9abac3fc322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:23.373048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1429/2840] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:23 2022] DELETE /identity/v3/projects/c0297cf25d6a412c972afecbdf21b127 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:23.378257 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.378740 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.378861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.398582 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:23.400369 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:23.412625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.460043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1412/2841] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:23.526270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.526561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.526846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.547625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:23.548864 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:23.556778 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1430/2842] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:23.561080 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.571528 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e10bb-7e42-4df9-9c95-8f6a710f90e1 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.576863 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.577020 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.577306 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.577609 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.578307 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:23.578613 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.580274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.592952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1413/2843] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:23.597255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.606575 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d42855-56c4-493f-89a1-78d355c5bb62 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.611255 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.611892 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.612183 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.612460 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.613139 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.615028 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.708872 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1431/2844] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:02:23.713878 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.723971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8a25f-90aa-4e65-af33-a3543f4eb461 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.781167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.781796 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.782074 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.782347 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.783003 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.784936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.873828 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1414/2845] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/users => generated 281 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:23.878337 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.889504 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14f3b-b630-42b8-aa7b-30c471381b99 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.894368 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.894984 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.895269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.895547 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.896312 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.897885 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.903876 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.908980 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1432/2846] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:23.912988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.923114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c349-f938-4dda-8286-29617cca4951 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.928638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592cc5e-e817-442c-9b2f-656707631635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.928638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592cc5e-e817-442c-9b2f-656707631635 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.928904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592cc5e-e817-442c-9b2f-656707631635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.929098 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592cc5e-e817-442c-9b2f-656707631635 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.929823 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592cc5e-e817-442c-9b2f-656707631635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.931998 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592cc5e-e817-442c-9b2f-656707631635 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.942661 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1415/2847] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:23.946867 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.958617 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57980906-0874-41e6-ad26-2bad24da71b5 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.963467 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.964163 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.964444 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.964720 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] PATH_INFO: `/v3/projects/b0c16516f79e4faea1c33251ca8768bd/users/70222a7a077b4d04bb94b18376410ec9/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.979400 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c16516f79e4faea1c33251ca8768bd, user_id=70222a7a077b4d04bb94b18376410ec9, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.982074 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.056670 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1433/2848] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:23 2022] PUT /identity/v3/projects/b0c16516f79e4faea1c33251ca8768bd/users/70222a7a077b4d04bb94b18376410ec9/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:24.066872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.067167 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.067443 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.095965 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] MFA Rules not processed for user `70222a7a077b4d04bb94b18376410ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:24.097188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:24.161297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1416/2849] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:02:24.195628 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.198094 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:24.262179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b508f9-e7b7-4644-99ca-4281ee27d74f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.265946 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcf0bf-1b23-4e75-be04-232009b08d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.266673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf0bf-1b23-4e75-be04-232009b08d0d service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.266967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf0bf-1b23-4e75-be04-232009b08d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.267250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf0bf-1b23-4e75-be04-232009b08d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.276124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf0bf-1b23-4e75-be04-232009b08d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:24.277595 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf0bf-1b23-4e75-be04-232009b08d0d service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.287370 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1434/2850] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:24.303319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.317889 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:24.369709 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cece57-b4d1-4ce2-88cb-1cf405c963b0 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.374248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.375122 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.375624 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.375953 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] PATH_INFO: `/v3/users/70222a7a077b4d04bb94b18376410ec9` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.377267 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=70222a7a077b4d04bb94b18376410ec9)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:24.379534 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.584284 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70222a7a077b4d04bb94b18376410ec9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:24.584851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70222a7a077b4d04bb94b18376410ec9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:24.637396 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70222a7a077b4d04bb94b18376410ec9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:24.638013 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70222a7a077b4d04bb94b18376410ec9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:24.650971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70222a7a077b4d04bb94b18376410ec9'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:24.663227 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1417/2851] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:24 2022] DELETE /identity/v3/users/70222a7a077b4d04bb94b18376410ec9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:24.668650 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.668997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.669264 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.688538 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:24.689755 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:24.748269 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1435/2852] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:24.758399 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.759941 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:24.817028 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27695675-0080-4b16-90f6-5c88035b64cc admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.820745 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02ee9e-069e-4ba1-9e9c-6bf8052aa088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.821457 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02ee9e-069e-4ba1-9e9c-6bf8052aa088 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.821752 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02ee9e-069e-4ba1-9e9c-6bf8052aa088 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.822038 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02ee9e-069e-4ba1-9e9c-6bf8052aa088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.831530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02ee9e-069e-4ba1-9e9c-6bf8052aa088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:24.833025 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02ee9e-069e-4ba1-9e9c-6bf8052aa088 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.843182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1418/2853] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:25.292046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:25.293481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:25.308967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57107-f7b6-458a-94e2-05751f86c1f2 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:25.313612 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:25.314270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:25.314562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:25.314841 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] PATH_INFO: `/v3/projects/b0c16516f79e4faea1c33251ca8768bd` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:25.316051 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c16516f79e4faea1c33251ca8768bd)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:25.318339 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:25.457179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c16516f79e4faea1c33251ca8768bd', 'request_id': 'req-91358dfc-14cc-4d92-bac3-463a8591f4d6'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:25.463282 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c16516f79e4faea1c33251ca8768bd', 'request_id': 'req-91358dfc-14cc-4d92-bac3-463a8591f4d6'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:25.468773 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c16516f79e4faea1c33251ca8768bd', 'request_id': 'req-91358dfc-14cc-4d92-bac3-463a8591f4d6'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:25.559085 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] The token cache is being invalidate because project b0c16516f79e4faea1c33251ca8768bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:25.559378 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:25.560031 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-91358dfc-14cc-4d92-bac3-463a8591f4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:25.561664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1436/2854] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:25 2022] DELETE /identity/v3/projects/b0c16516f79e4faea1c33251ca8768bd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:25.566646 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:25.567132 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:25.567252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:25.588280 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:25.589490 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:25.621371 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:25.650805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1419/2855] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:25.658532 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:25.658829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:25.659140 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:25.667178 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:25.679733 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:25.681535 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:25.689814 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1437/2856] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:25.694327 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:25.704354 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504d8b-72da-4eb6-b7ab-6b4cc9f77739 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:25.709068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:25.709622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:25.709905 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:25.710183 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:25.710952 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:25.711188 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:25.712999 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:25.724641 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1420/2857] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:25.729287 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:25.738569 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89cff-4a7c-47d1-ae8f-a120bc5c57a5 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:25.744164 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:25.744777 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:25.745063 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:25.745338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:25.746050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:25.748007 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:25.863717 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1438/2858] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:25 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:25.868728 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:25.879476 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b224011-839b-4764-9aa0-385425273114 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:25.937555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:25.938213 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:25.938502 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:25.938785 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:25.939486 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:25.941541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:26.050864 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1421/2859] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:25 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:26.055056 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.066123 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca40f-87d3-4c70-9f20-4ecfe9f46ab9 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:26.070836 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:26.072050 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.072338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.072616 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.073319 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:26.074906 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:26.084880 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1439/2860] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:26.089560 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.099586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96758fd4-1ef6-4490-a9e5-3efb7a4fb33d admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:26.104252 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a161-40ef-4c55-a562-097f7ca76237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:26.104862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a161-40ef-4c55-a562-097f7ca76237 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.105149 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a161-40ef-4c55-a562-097f7ca76237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.105430 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a161-40ef-4c55-a562-097f7ca76237 admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.106121 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887a161-40ef-4c55-a562-097f7ca76237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:26.107716 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887a161-40ef-4c55-a562-097f7ca76237 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:26.118342 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1422/2861] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:26.122325 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.132732 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b31e3-e7d9-46e4-8064-4763083fe859 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:26.138250 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:26.138948 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.139231 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.139509 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] PATH_INFO: `/v3/projects/e73710c3ce2b42bea34b8952dca94dd6/users/e4112a6adcb54f2f969de23e428ee408/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.154914 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73710c3ce2b42bea34b8952dca94dd6, user_id=e4112a6adcb54f2f969de23e428ee408, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:26.157611 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:26.233657 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1440/2862] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:26 2022] PUT /identity/v3/projects/e73710c3ce2b42bea34b8952dca94dd6/users/e4112a6adcb54f2f969de23e428ee408/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:26.246070 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.246374 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.246659 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.276184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] MFA Rules not processed for user `e4112a6adcb54f2f969de23e428ee408`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:26.277494 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:26.345001 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1423/2863] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:26.356688 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.360310 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:26.416568 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a32f-8940-49b7-9ead-3d225a0b720f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:26.420236 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06ad7d-2f9e-4f89-9a14-a5aec3a393c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a8f7e27170404ebf1a2be70efe63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:26.420883 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06ad7d-2f9e-4f89-9a14-a5aec3a393c3 service glance] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.421180 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06ad7d-2f9e-4f89-9a14-a5aec3a393c3 service glance] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.421440 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06ad7d-2f9e-4f89-9a14-a5aec3a393c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.431489 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06ad7d-2f9e-4f89-9a14-a5aec3a393c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:26.433117 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06ad7d-2f9e-4f89-9a14-a5aec3a393c3 service glance] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:26.442022 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1441/2864] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:36.341996 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:36.438046 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:51.748664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:51.819961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0104a-2b04-4258-b7fc-eaef02dfca21 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.824627 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.825456 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.825748 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.826568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] PATH_INFO: `/v3/users/e4112a6adcb54f2f969de23e428ee408` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.827519 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4112a6adcb54f2f969de23e428ee408)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.829633 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:52.051569 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4112a6adcb54f2f969de23e428ee408'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.052152 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4112a6adcb54f2f969de23e428ee408'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.118335 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4112a6adcb54f2f969de23e428ee408'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.118976 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4112a6adcb54f2f969de23e428ee408'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.132536 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4112a6adcb54f2f969de23e428ee408'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.145672 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1424/2865] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:02:51 2022] DELETE /identity/v3/users/e4112a6adcb54f2f969de23e428ee408 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:52.150292 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:52.150795 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:52.150899 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:52.170541 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:52.171782 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:52.235877 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1442/2866] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:52.245671 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:52.247126 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:52.310059 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11155-45c2-4668-a33d-6b99d3bcfcdb admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:52.314449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab83f28-970b-4570-944a-8fb3226161d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:52.315068 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab83f28-970b-4570-944a-8fb3226161d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:52.315350 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab83f28-970b-4570-944a-8fb3226161d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:52.315625 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab83f28-970b-4570-944a-8fb3226161d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:52.326923 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab83f28-970b-4570-944a-8fb3226161d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:52.328799 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab83f28-970b-4570-944a-8fb3226161d3 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:52.340142 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1425/2867] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:52.788470 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:52.790092 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:52.808036 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6a2e1-12be-46bd-a98a-96a6a49747fb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:52.809540 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:52.810252 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:52.811146 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:52.811430 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] PATH_INFO: `/v3/projects/e73710c3ce2b42bea34b8952dca94dd6` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:52.812699 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73710c3ce2b42bea34b8952dca94dd6)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:52.814636 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:52.943490 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73710c3ce2b42bea34b8952dca94dd6', 'request_id': 'req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.950038 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73710c3ce2b42bea34b8952dca94dd6', 'request_id': 'req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:52.956410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73710c3ce2b42bea34b8952dca94dd6', 'request_id': 'req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:53.038114 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] The token cache is being invalidate because project e73710c3ce2b42bea34b8952dca94dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:02:53.038406 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:53.039070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-37c21c81-85c9-4e05-9ee8-a7b3cb658f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:02:53.040625 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1443/2868] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:02:52 2022] DELETE /identity/v3/projects/e73710c3ce2b42bea34b8952dca94dd6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:53.046326 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.046815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.046956 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.067454 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:53.068704 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:53.085319 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.129782 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1426/2869] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:02:53.137521 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.137819 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.138104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.158559 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:53.159828 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:53.167838 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1444/2870] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:53.172767 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.182539 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20550198-aeb9-4e36-b624-05f5dbc40ceb None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.187063 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.187669 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.187982 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.188254 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.188971 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:53.189274 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.190861 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.202848 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1427/2871] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:53.207374 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.217065 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49d2b-bb71-45d4-92e6-ce7670d80066 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.221718 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.222329 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.222613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.222889 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.223590 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.225526 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.320187 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1445/2872] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:53.324436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.335199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16bb42-a9f6-4d4a-a776-b9cba1cf2b44 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.392786 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.393404 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.393690 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.393969 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.394635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.396616 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.495930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1428/2873] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:53.500544 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.510941 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888ec3d-852b-4d27-9fab-c9d0cb71f88f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.515966 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.516588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.516917 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.517221 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.517913 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.519505 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.529817 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1446/2874] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:02:53.533851 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.543961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee73b-3d2d-418c-ad26-55a19f35c316 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.549216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092418-4e9d-4cb4-ae11-324aca71f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.549825 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092418-4e9d-4cb4-ae11-324aca71f52b admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.550136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092418-4e9d-4cb4-ae11-324aca71f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.550412 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092418-4e9d-4cb4-ae11-324aca71f52b admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.551136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092418-4e9d-4cb4-ae11-324aca71f52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.552776 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092418-4e9d-4cb4-ae11-324aca71f52b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.564159 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1429/2875] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:02:53.568344 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.578561 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c6f0a-b8b4-4aae-86fa-3a51a3266955 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.583101 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.583751 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.584064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.584340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] PATH_INFO: `/v3/projects/63044456fdb9478b81ea991d96c51ac9/users/0ab9d25724f147f6a01d9ef7b1c07afb/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.598716 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63044456fdb9478b81ea991d96c51ac9, user_id=0ab9d25724f147f6a01d9ef7b1c07afb, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.601404 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.678673 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1447/2876] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:02:53 2022] PUT /identity/v3/projects/63044456fdb9478b81ea991d96c51ac9/users/0ab9d25724f147f6a01d9ef7b1c07afb/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:53.691184 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.691471 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.691773 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.720175 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] MFA Rules not processed for user `0ab9d25724f147f6a01d9ef7b1c07afb`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:53.721397 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:53.785216 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1430/2877] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:53.797927 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.799613 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:53.821271 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.858202 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bef9c6-2730-495e-9f96-b9a5a00bc55f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.862491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2602f-a63f-46f1-8947-62f5900e73ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.863119 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2602f-a63f-46f1-8947-62f5900e73ae service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.863410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2602f-a63f-46f1-8947-62f5900e73ae service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.863691 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2602f-a63f-46f1-8947-62f5900e73ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.872318 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2602f-a63f-46f1-8947-62f5900e73ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.873854 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2602f-a63f-46f1-8947-62f5900e73ae service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.883401 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1448/2878] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:03.782387 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:03.934514 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=17 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:28.693500 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:28.760187 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e043073-a3a7-49bb-b8d4-12a045965c32 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:28.765199 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:28.765841 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:28.766127 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:28.766409 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] PATH_INFO: `/v3/users/0ab9d25724f147f6a01d9ef7b1c07afb` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:28.767733 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab9d25724f147f6a01d9ef7b1c07afb)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:28.769623 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:28.936375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab9d25724f147f6a01d9ef7b1c07afb'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:28.937043 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab9d25724f147f6a01d9ef7b1c07afb'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.003615 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab9d25724f147f6a01d9ef7b1c07afb'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.004278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab9d25724f147f6a01d9ef7b1c07afb'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.017435 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab9d25724f147f6a01d9ef7b1c07afb'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.031157 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1431/2879] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:03:28 2022] DELETE /identity/v3/users/0ab9d25724f147f6a01d9ef7b1c07afb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:29.035562 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.036073 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.036270 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.057315 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:29.058656 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:29.133191 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1449/2880] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:03:29.143299 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:29.144897 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:29.203622 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5d9e-d270-40a0-906d-d15bf406d5b9 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:29.207664 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde43dd-5e4b-4f73-a42c-87ba8adcaf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:29.208315 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde43dd-5e4b-4f73-a42c-87ba8adcaf1c service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.208599 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde43dd-5e4b-4f73-a42c-87ba8adcaf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.208871 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde43dd-5e4b-4f73-a42c-87ba8adcaf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.218461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde43dd-5e4b-4f73-a42c-87ba8adcaf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:29.219924 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde43dd-5e4b-4f73-a42c-87ba8adcaf1c service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:29.229408 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1432/2881] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:29.628802 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:29.630300 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:29.643804 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e186-385f-4416-9a2c-71c686ffa430 None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:29.648803 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:29.649484 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.649764 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.650070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] PATH_INFO: `/v3/projects/63044456fdb9478b81ea991d96c51ac9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.651294 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] RBAC: Authorizing `identity:delete_project(project_id=63044456fdb9478b81ea991d96c51ac9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:29.654336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:29.781693 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63044456fdb9478b81ea991d96c51ac9', 'request_id': 'req-de110ae4-a71b-4975-8e88-716c343c214d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.788043 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63044456fdb9478b81ea991d96c51ac9', 'request_id': 'req-de110ae4-a71b-4975-8e88-716c343c214d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.793997 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63044456fdb9478b81ea991d96c51ac9', 'request_id': 'req-de110ae4-a71b-4975-8e88-716c343c214d'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.860229 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] The token cache is being invalidate because project 63044456fdb9478b81ea991d96c51ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:03:29.860478 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.861122 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-de110ae4-a71b-4975-8e88-716c343c214d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:29.862682 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1450/2882] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:03:29 2022] DELETE /identity/v3/projects/63044456fdb9478b81ea991d96c51ac9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:29.867884 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.868461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.868461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.889973 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:29.891244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:29.908300 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:29.952800 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1433/2883] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:29.960179 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.960474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.960781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.980567 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.auth.core [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:29.982071 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:29.990011 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1451/2884] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:29.994555 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.005468 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6d12a-62f4-42f1-b0c1-f936ddfbf615 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.010114 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.010737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.011023 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.011303 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.012630 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:30.012939 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.014541 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.026297 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1434/2885] 10.222.0.40 () {58 vars in 1153 bytes} [Mon Jul 25 23:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:30.030703 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.040481 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f69a17-e57f-46ba-8f16-42486752bccb None None] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.045525 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.046141 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] REQUEST_METHOD: `POST` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.046428 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.046706 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] PATH_INFO: `/v3/projects` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.047418 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.049376 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.136113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1452/2886] 10.222.0.40 () {60 vars in 1153 bytes} [Mon Jul 25 23:03:30 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:30.138052 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.149272 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cdc1-fbf9-4846-9d48-e6b9bb4c7bb6 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.214906 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.215621 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.215948 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.216230 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] PATH_INFO: `/v3/users` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.216904 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.218834 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.317174 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1435/2887] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:30 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:30.319816 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.330792 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ceb77-cacc-4225-af47-7855f985b48d admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.336070 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.336729 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.337016 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.337301 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] PATH_INFO: `/v3/roles` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.338012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.339781 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.350775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1453/2888] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:30.354844 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.366737 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9377-89a8-48e2-870c-2613afdf57a0 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.372562 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8560c37-4a80-4eba-8003-94464c81bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.373684 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560c37-4a80-4eba-8003-94464c81bacc admin admin] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.374095 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560c37-4a80-4eba-8003-94464c81bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.375540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560c37-4a80-4eba-8003-94464c81bacc admin admin] PATH_INFO: `/v3/roles` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.375821 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8560c37-4a80-4eba-8003-94464c81bacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.378026 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8560c37-4a80-4eba-8003-94464c81bacc admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.391530 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1436/2889] 10.222.0.40 () {58 vars in 1122 bytes} [Mon Jul 25 23:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:30.396091 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.406506 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451596e-17d2-4968-b225-d9a91f4b3202 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.411829 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.412537 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.412826 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.413107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] PATH_INFO: `/v3/projects/2cad6827b4a74eb988ce53c6d647c895/users/9406f3c78c3347bf97cf1746ca718cc1/roles/2f3be5e1b4134b18b93f08ffd7566aa9` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.428923 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cad6827b4a74eb988ce53c6d647c895, user_id=9406f3c78c3347bf97cf1746ca718cc1, role_id=2f3be5e1b4134b18b93f08ffd7566aa9)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.431704 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.523410 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1454/2890] 10.222.0.40 () {60 vars in 1483 bytes} [Mon Jul 25 23:03:30 2022] PUT /identity/v3/projects/2cad6827b4a74eb988ce53c6d647c895/users/9406f3c78c3347bf97cf1746ca718cc1/roles/2f3be5e1b4134b18b93f08ffd7566aa9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:30.541048 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f62f-a38e-4808-a044-f64c6c1b86d5 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.541334 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f62f-a38e-4808-a044-f64c6c1b86d5 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.541610 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f62f-a38e-4808-a044-f64c6c1b86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.585222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-5198f62f-a38e-4808-a044-f64c6c1b86d5 None None] MFA Rules not processed for user `9406f3c78c3347bf97cf1746ca718cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:30.585222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-5198f62f-a38e-4808-a044-f64c6c1b86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:30.686812 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1437/2891] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:03:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:30.700054 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.701818 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:30.727622 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:30.765230 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054c68-1f5b-425e-acbf-07c9310f4c0f admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.769336 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4957fb8ec82d40f985b586cda019a0ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.772441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.772441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.772441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.772949 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126e3a-ffbe-44c7-aa33-0b8a76600054 None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.773286 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126e3a-ffbe-44c7-aa33-0b8a76600054 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.773518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126e3a-ffbe-44c7-aa33-0b8a76600054 None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.774868 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1438/2892] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 23:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:30.780809 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.781346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.781635 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.781930 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.782299 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.792068 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1455/2893] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:30.803407 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] MFA Rules not processed for user `d361924fd6fc4cf2891d60fcad455a44`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:30.804667 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:30.819218 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:30.821075 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.864136 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1439/2894] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 23:03:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:03:30.877346 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.878961 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:30.886551 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd751d5f-8003-4166-9efa-44db86882ea6 service cinder] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.890222 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600608c4-3530-4236-aa53-5c8d791df9cd None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.892474 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.897181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.897181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.897181 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] PATH_INFO: `/v3/users/9406f3c78c3347bf97cf1746ca718cc1` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.897518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc61b-f85c-428b-a1a2-30c954399ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.897518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc61b-f85c-428b-a1a2-30c954399ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.897518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc61b-f85c-428b-a1a2-30c954399ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.897799 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9406f3c78c3347bf97cf1746ca718cc1)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.897899 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc61b-f85c-428b-a1a2-30c954399ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.898012 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.903900 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc61b-f85c-428b-a1a2-30c954399ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.905446 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc61b-f85c-428b-a1a2-30c954399ee5 service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.914083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1440/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:03:31.004572 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3818-1070-4819-924d-ed62c0f5ce0b None None] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.004860 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3818-1070-4819-924d-ed62c0f5ce0b None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.005137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b3818-1070-4819-924d-ed62c0f5ce0b None None] PATH_INFO: `/` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.006532 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1441/2896] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 25 23:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:03:31.011488 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.012482 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.012872 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.046478 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] MFA Rules not processed for user `f27a1a3e92fa4293a57b8b4024d065b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:31.047736 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:31.131083 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1442/2897] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 25 23:03:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:03:31.132633 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9406f3c78c3347bf97cf1746ca718cc1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:31.133309 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9406f3c78c3347bf97cf1746ca718cc1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:31.142277 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:31.143709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9406f3c78c3347bf97cf1746ca718cc1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:31.143709 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9406f3c78c3347bf97cf1746ca718cc1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:31.152244 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823608-bb97-43b4-a6ed-062406ff5529 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:31.156459 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:31.156898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9406f3c78c3347bf97cf1746ca718cc1'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:31.157104 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.157384 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.157662 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.159474 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:31.172962 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:31.175723 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9acac-f630-4bbe-a433-4e188372c82d service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:31.186005 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1443/2898] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:03:31.215996 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1456/2899] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:03:30 2022] DELETE /identity/v3/users/9406f3c78c3347bf97cf1746ca718cc1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:03:31.220936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] REQUEST_METHOD: `POST` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.227654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.227654 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.243150 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.auth.core [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] MFA Rules not processed for user `0e22f2132e234963b03344d9530151a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:31.244504 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:31.312279 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1444/2900] 10.222.0.40 () {58 vars in 958 bytes} [Mon Jul 25 23:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:03:31.321975 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:31.323403 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:31.380904 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:31.393267 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674b73e-2dd0-4c11-935c-5bf05d91bb8b admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:31.397241 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:31.397871 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.398113 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.398807 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.408719 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:31.414379 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:31.420911 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1457/2901] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:31.844970 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:31.846501 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:31.862323 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8badeae-3c72-4d37-b66e-73a0a6766184 None None] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:31.868389 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:31.869248 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.869632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.870007 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] PATH_INFO: `/v3/projects/2cad6827b4a74eb988ce53c6d647c895` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.872221 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cad6827b4a74eb988ce53c6d647c895)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:31.874954 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:31.885568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=100 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:32.009771 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cad6827b4a74eb988ce53c6d647c895', 'request_id': 'req-3b869b32-d392-4279-bc63-d5d59d88bbcd'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:32.088819 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cad6827b4a74eb988ce53c6d647c895', 'request_id': 'req-3b869b32-d392-4279-bc63-d5d59d88bbcd'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:32.095997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cad6827b4a74eb988ce53c6d647c895', 'request_id': 'req-3b869b32-d392-4279-bc63-d5d59d88bbcd'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:32.108196 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] The token cache is being invalidate because project 2cad6827b4a74eb988ce53c6d647c895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:03:32.108487 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:32.109137 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:03:32.110726 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1445/2902] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:03:31 2022] DELETE /identity/v3/projects/2cad6827b4a74eb988ce53c6d647c895 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:03:40.071491 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:40.081160 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470397-a557-4d49-86d1-dbaf44b87476 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:40.139846 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:40.140518 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:40.140822 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:40.141104 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:40.143048 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:40.217384 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:40.218835 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:40.230589 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1458/2903] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:42.104506 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:43.821522 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:43.823112 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:43.836648 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869b32-d392-4279-bc63-d5d59d88bbcd admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:43.841000 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:43.841869 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:43.843390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:43.843390 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:43.844987 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:43.860185 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:43.861790 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:43.874551 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1446/2904] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:50.225259 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=61 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:53.868742 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:49.626511 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:49.635859 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aab6e-dd6b-4667-9f68-e0ec8f502098 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:49.639601 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd361924fd6fc4cf2891d60fcad455a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:49.640262 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:49.640553 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:49.640840 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:49.642634 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:49.652967 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:49.654450 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:49.663023 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1459/2905] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:58.787850 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:58.789278 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:58.805116 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83044-c9f7-428b-8d23-746b5bfc9f3f service neutron] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:58.813805 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:58.815017 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:58.815518 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:58.816027 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:58.818240 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:58.834885 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:58.836936 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:58.851317 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1447/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:59.659128 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=6 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:01.284588 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:01.299679 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a369c-37c9-4789-8920-f328711974c3 service neutron] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:01.305533 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a1a3e92fa4293a57b8b4024d065b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:01.306220 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] REQUEST_METHOD: `GET` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:01.306515 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:01.306825 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:01.308711 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:01.322441 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:01.324044 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:01.335453 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1460/2907] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:08.851461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=6 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.330579 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=6 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:13.143929 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:13.145680 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:13.225458 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00212409-e44e-4104-b8b9-14a31a2027c9 service nova] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:13.230586 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:13.231255 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:13.231540 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:13.231859 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] PATH_INFO: `/v3/users/2212397575374e2d92cdd2a68bbc5535` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:13.233211 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2212397575374e2d92cdd2a68bbc5535)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:13.235182 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:13.502829 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2212397575374e2d92cdd2a68bbc5535'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:13.503585 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2212397575374e2d92cdd2a68bbc5535'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:13.572643 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2212397575374e2d92cdd2a68bbc5535'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:13.573492 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2212397575374e2d92cdd2a68bbc5535'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:13.588670 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2212397575374e2d92cdd2a68bbc5535'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:13.602055 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1448/2908] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:13 2022] DELETE /identity/v3/users/2212397575374e2d92cdd2a68bbc5535 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:13.907552 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:13.925204 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd399e-efb9-4ffa-abf0-3ea12012abc5 service nova] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.005522 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.006203 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.006495 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.006775 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] PATH_INFO: `/v3/projects/743cbb9452884066ae720dc504eee7f8` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.008340 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743cbb9452884066ae720dc504eee7f8)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.011124 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:14.128058 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743cbb9452884066ae720dc504eee7f8', 'request_id': 'req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.135573 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743cbb9452884066ae720dc504eee7f8', 'request_id': 'req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.142637 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743cbb9452884066ae720dc504eee7f8', 'request_id': 'req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.230402 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] The token cache is being invalidate because project 743cbb9452884066ae720dc504eee7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:14.230665 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.231546 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.233338 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1461/2909] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:13 2022] DELETE /identity/v3/projects/743cbb9452884066ae720dc504eee7f8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:14.237756 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:14.239461 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:14.255324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b05c2-14f2-4861-b9bb-1dde97bc8d8b admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:14.327862 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:14.328568 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:14.328855 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:14.329141 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] PATH_INFO: `/v3/users/d94b39a7e76b4a29826c7379a67e2aa7` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:14.330449 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94b39a7e76b4a29826c7379a67e2aa7)` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:14.332526 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:14.360010 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:14.548632 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94b39a7e76b4a29826c7379a67e2aa7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.549236 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94b39a7e76b4a29826c7379a67e2aa7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.640652 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94b39a7e76b4a29826c7379a67e2aa7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.641689 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94b39a7e76b4a29826c7379a67e2aa7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.660804 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.notifications [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94b39a7e76b4a29826c7379a67e2aa7'} {{(pid=87130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:14.673638 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1449/2910] 10.222.0.40 () {58 vars in 1224 bytes} [Mon Jul 25 23:05:14 2022] DELETE /identity/v3/users/d94b39a7e76b4a29826c7379a67e2aa7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:15.004026 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Authenticating user token {{(pid=87131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.011485 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.fernet_utils [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.025898 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c678cf2-f9b7-48d8-bb4e-b4ce2da42264 admin admin] Validating token access rules against request {{(pid=87131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.093432 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e22f2132e234963b03344d9530151a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1511155764c640988e6e51d316abf862', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.094062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.094391 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.094750 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] PATH_INFO: `/v3/projects/23aae88bf8264238be77a1f31edf50f0` {{(pid=87131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.096352 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23aae88bf8264238be77a1f31edf50f0)` {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.098433 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] RBAC: Authorization granted {{(pid=87131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.264077 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:15.276789 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23aae88bf8264238be77a1f31edf50f0', 'request_id': 'req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.283620 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23aae88bf8264238be77a1f31edf50f0', 'request_id': 'req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.289779 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23aae88bf8264238be77a1f31edf50f0', 'request_id': 'req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075'} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.385064 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] The token cache is being invalidate because project 23aae88bf8264238be77a1f31edf50f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:05:15.385415 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.386062 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG keystone.notifications [None req-0aa9b1bf-c55d-4dae-8aa8-96dad0db9075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:05:15.387664 dv-cinder-797608-63-smb devstack@keystone.service[87131]: [pid: 87131|app: 0|req: 1462/2911] 10.222.0.40 () {58 vars in 1233 bytes} [Mon Jul 25 23:05:15 2022] DELETE /identity/v3/projects/23aae88bf8264238be77a1f31edf50f0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:24.669988 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.435107 dv-cinder-797608-63-smb devstack@keystone.service[87131]: DEBUG dbcounter [-] [87131] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:49.907324 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Authenticating user token {{(pid=87130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:06:49.908815 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:49.984603 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349767-acdb-4d9a-9370-adc08f694da1 admin admin] Validating token access rules against request {{(pid=87130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:06:50.050356 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c508de5b7417417da87d702090178c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e12b34755d58449183dd5fc2a17d16db', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:06:50.050997 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] REQUEST_METHOD: `GET` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:50.051285 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] SCRIPT_NAME: `/identity` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:50.051566 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:50.053436 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.fernet_utils [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:50.065703 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:06:50.067316 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628919c7-8d57-4d8f-8791-66a4b0435a30 service placement] RBAC: Authorization granted {{(pid=87130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:06:50.078375 dv-cinder-797608-63-smb devstack@keystone.service[87130]: [pid: 87130|app: 0|req: 1450/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 25 23:06:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:07:00.073561 dv-cinder-797608-63-smb devstack@keystone.service[87130]: DEBUG dbcounter [-] [87130] Writing DB stats keystone:SELECT=58 {{(pid=87130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}